CourseLarge Language Models: The Complete Course · Module 9: Fine-Tuning and Adaptation · part 65 of 103
Part 65 · Module 9: Fine-Tuning and Adaptation

Lesson 4: Teaching preferences, then checking what broke

25 min read·13 Oct 2026
Module 9 · Lesson 4 · About 55 minutes · Needs: Module 9 Lesson 1 (the frozen plan and check_plan); Lesson 3 helps (what a LoRA adapter is)

The situation

It is Thursday 30 July 2026, week 9. Lena and Ravi have read SmolLM2's drafts for the 24 dev tickets. To Ana Duarte's duplicate charge, T-1001, it writes "as a support chatbot, I don't have the ability to access or process" anything.

Maya wants one thing: never brush a customer off. Name the help-centre article that answers the ticket, or say a person will check. Lena can pick the better of two drafts far faster than she can write a perfect one. This lesson trains on that judgement, then measures what it bought.

The rest of this course is yours to keep

This course is bought on its own, once, and stays readable afterwards, including the parts added to it later.