AI Post Transformers • Interactive Visualization

Teaching Language Models to Verbalize Uncertainty

The episode’s core move is visual: uncertainty should attach to a claim, not to the next token alone. This page turns that distinction into diagrams, calibration plots, semantic clusters, and shift stress-tests.

Stephanie Lin, Jacob Hilton, Owain Evans arXiv:2205.14334 Open paper Published viz
4 interactive visual lenses
3x confidence modes compared
IID → Shift calibration under stress
token uncertainty epistemic uncertainty semantic entropy verbalized calibration

Reference Constellation

Compact pointers to the papers and prior podcast links driving the visuals.