Module 6: Training Dynamics
1 min read·13 Oct 2026
What you need first
- Module 5 and its lab (
tinyformer-labatv0.5.0; this module's lab rebuilds a stand-in if needed) - From AI Engineering Module 4: skim the sections on optimisers, schedules and initialisation
- No GPU, no API key