CourseTransformers: From Attention to Trained, Served and Interpreted Models · Module 2: Self-Attention Mechanics · part 12 of 111

Part 12 · Module 2: Self-Attention Mechanics

Module 2: Self-Attention Mechanics

1 min read·13 Oct 2026

What you need first

Module 1 and its lab (tinyformer-lab at v0.1.0; the lab rebuilds a stand-in if needed)
Tensors, matrix products and softmax (Module 1, Lesson 1)
After AI Engineering Module 6, Lesson 1, skim section 1 of Lessons 1 and 3
No GPU, no API key

This course is bought on its own, once, and stays readable afterwards, including the parts added to it later.