Atlas: Test-Time Memory for Long Contexts

Atlas asks whether a model with fixed recurrent memory can learn to write better during inference and rival long-context Transformers. The page below keeps the text light and pushes the tradeoff into diagrams: exact token access versus bounded state, single-token writes versus windowed writes, and promising gains versus an information bottleneck that never fully disappears.