Click a step. Four moves: train, wander, average, repair BatchNorm.
Baseline schedule as described in the episode vs the SWA continuation. SWA rate levels: Illustrative
Test-time cost of an ensemble scales linearly with members (FGE typically collects six to twelve).
Schematic loss bowl with noisy high-rate iterates on a shell. Illustrative, synthetic points
A narrow minimum is fragile under the shift; a wide one stays good. Illustrative toy curves
Numbers quoted in the episode. Bar axes may not start at zero; the axis floor is printed.
Distance walked before loss rises by a threshold. Illustrative curves
Scale one layer by α and the next by 1/α: same function, different weight-space width. Toy: L=(w1·w2−1)²
Click a claim. Tags reflect the episode’s qualitative assessment, not a numeric score.
Budget layout from the episode. SGD baseline: constant to 0.5, linear decay to 1% by 0.9, then flat.