Lab: The bake-off, every model on one test set
114 min read·14 Oct 2026
Module 10 · Lab · About 75 minutes · Needs: lessons 1 to 4 of this module, and the Module 9 lab (or its cells, pasted here). CPU only; a Groq or Gemini key only if you switch the hosted rows on
What you are building
It is Thursday 12 November 2026, project week 10. Rosa wants one table before she decides anything: every model the course has built, on the same 80 hand-written messages, with what each costs and whether a customer's name changes the answer.
This lab settles the four lessons' files once, then runs the bake-off: four local models for real, two hosted LLM rows switched off until you add a key, a cost table from course-guide/02's prices, a hybrid router and a name-swap check. It ends with one report in reports/.
Open a new Colab notebook, call it module-10-lab.ipynb, and run each cell in order.