Lesson 1: Evaluation built into the platform
47 min read·
Module 13 · Lesson 1 · About 50 minutes · Needs: Module 2 lesson 2 (the quality bar), Module 6 lesson 3 (retrieval and generation scored apart), Module 10 lesson 6 (bundles and the pipeline gate). One optional block calls a hosted model; the rest needs no key
The situation
Week 13, Monday 25 January 2027. Ana wants Ask's cost down. A new candidate shortens the prompt to ask-v10 (added in this lesson) and retrieves 6 chunks instead of 12. Gareth asks how you would know it got worse, and where. Joel asks whether employees will notice. Helen wants the answer before anything ships.
The running example is golden question G051. Dmitri Costa (t-marlow-u026), in IT at Marlow County Council, asks "How many weeks of parental leave are on full pay?". The Family leave policy says 16.