AI Post Transformers • Visual Companion

Geometric Memory in Deep Sequence Models

The central visual question: does a trained sequence model answer graph queries by chaining memorized edges, or by moving through a latent geometry where many-hop relations have already been compressed into short paths?

2510.26745 Source paper Interactive viz URL Theme amortized reasoning vs lookup
4
visual lenses: pipeline, query collapse, matrix geometry, and debate frontier
3→1
conceptual compression: a multi-hop path behaving like a short latent move
1
arXiv ID detected in transcript: 2510.26745
latent map sketch graph facts → geometry
training edges learned embedding neighborhoods held-out path query

1. From Edge Facts to a Latent Map

The paper’s claim is easiest to see as a conversion pipeline: local supervision on graph edges first writes memories into weights, then those memories reorganize into a geometry that can answer queries not seen directly.

2. Lookup Chain vs Geometric Shortcut

Toggle the retrieval story. In the associative view, answering a path query means traversing stored links. In the geometric view, the same answer emerges from a much shorter move in representation space.

3. Heatmaps of Memory Structure

These matrices use realistic mock values to contrast raw edge co-occurrence, a narrow lookup-style memory, and a smoother latent similarity map that reflects broader graph structure.

4. What Improves, and What Still Feels Fragile

The mock result panels below reflect the qualitative story from the discussion: held-out path queries improve when geometry emerges, but synthetic graph wins do not automatically settle the large-model reasoning debate.

References

01
Deep sequence models tend to memorize geometrically; it is unclear why Noroozizadeh, Nagarajan, Rosenfeld, Kumar • 2025 • arXiv:2510.26745
02
DeepWalk: Online Learning of Social Representations Perozzi, Al-Rfou, Skiena • 2014
04
Birth of a Transformer: A Memory Viewpoint Bietti, Cabannes, Bouchacourt, Jegou, Bottou • 2023
06
The Reversal Curse Berglund et al. • 2024