Lab: Decide: prompt, retrieve or fine-tune
Module 6 · Lab · About 60 minutes · Needs: lessons 3 and 4 (the three rungs, the change test, the cost columns)
What you are building
Module 6 ends with a written decision for Priya, Dev and Marta: should BrightCart's assistant answer policy questions by prompting a hosted model, by retrieving the policy line, or by fine-tuning a small model of its own? Lesson 4 made the argument with one question. A decision needs more. In this lab you run ten policy questions through all three rungs, score every answer, record tokens and latency, then change two policies and run again. The product is a scorecard with real numbers and a filled-in decision record. Nothing here is new machinery: the rungs, the fine-tune loop and the cost table are lesson 4's. What is new is doing it ten times, measuring, and writing it down.