Frozen Backbone, Explicit Transmission
One normal forward pass builds a hidden-state tape. A lightweight side system then performs depth-wise selection and width-wise allocation instead of repeatedly mutating memory tokens inside the model.
Soft slotsUpdated every layer, vulnerable to overwriting
Depth stageGates useful layers per token position
Width stageGlobal token-to-slot assignment
RiskExact recall still bottlenecked by latent capacity
Inside the Transmission System
Use the stage toggle to switch between layer selection and coordinated transport. Hover the matrices to inspect where information mass goes.
Benchmark Wins, with Scope Caveats
The transcript reports large gains over other soft compressors on six QA sets. Toggle backbones to compare the method landscape and dataset pattern.
ComprExIT
ICAE
500x
Beacon
Prompt-tuning baseline / reference
Where the Method Helps, and Where It Still Hurts
The deployment story motivates the work, but the experiment regime is still 512→128. The visuals below separate what was shown from what remains open for real long-context systems.