CourseLarge Language Models: The Complete Course · Course guide · part 1 of 103
Part 1 · Course guide

Large Language Models: The Complete Course

5 min read·13 Oct 2026

What a large language model is, how it reads and writes, how to make it reliable, how to test it, how to secure it and how to run it, measured on one real-shaped task from the first lesson to the last.

You build one thing: an assistant for the support desk at Quillpath, a project-management software company. It triages tickets, drafts replies from the help centre for a person to review, and handles refund requests by a written policy, never moving money without a person approving. Every technique in the course is measured on the same 36 tickets, so you see exactly what it changes. Quillpath is fictional and its data is simulated; every lesson also opens with a real, cited case.

Who this course is for

You can write Python: functions, classes, dictionaries, running a notebook. You do not need a machine learning background.

You are...Start at
New to language modelsModule 1, and go in order
A developer who already calls model APIsModule 1, Lesson 4 (limits, measured), then Module 2
Comfortable with prompts, weak on testingModule 4, Lesson 2, then Module 10
Building agents or toolsModules 6 and 8, then Module 11
Responsible for cost and operationsModules 2 and 13
New to PythonThe AI Engineering course, Module 1, first

Every module's README lists what you need to know before starting it, so you can check whether it is safe to skip the one before.

What you need

  • A Google account, to run code in Google Colab. Nothing to install.
  • One free API key, from Groq or Google Gemini, to use in Colab. Or no key at all, if you run a model on your own computer with Ollama and work in a code editor.
  • For a few lessons (a container, a GPU serving engine, a CI pipeline), your own computer. Those lessons say so.

Setup takes about ten minutes: course-guide/02-setup-colab-and-llm-providers.md.

The modules

#ModuleWhat you add to the support deskNeeds first
1What a Large Language Model IsThe shared data, one client for three providers, a first triage call, TinyLM, a model selectionPython
2Tokens, Context, and CostOne token counter, one price table, a context budget, a cost per ticketModule 1
3Inference and DecodingDecoding settings chosen per task, streaming, the cost of reasoningModules 1 and 2
4Prompt EngineeringVersioned prompts, a frozen test set and a harness that scores themModules 1 to 3
5Reasoning and Advanced PromptingRefund decisions by extract-then-rule, voting and a verifierModule 4
6Structured Outputs and Tool UseTyped triage output, repair loops, five tools and their guardsModules 2 and 4
7Context EngineeringHelp-centre retrieval, a context builder with budgets, memoryModules 2, 4 and 6
8AgentsA traced refund agent with budgets and an approval gate, served over MCPModules 6 and 7
9Fine-Tuning and AdaptationA LoRA trial on a small open model and a written decisionModules 1, 4 and 6
10EvaluationAn eval suite with confidence intervals, human ratings, a calibrated judge, a CI gateModule 4; Module 6 helps
11Safety, Security, and AlignmentMeasured defences against injection, redaction, a red-team setModules 6 and 8
12Multimodal ModelsIntake for screenshots, PDFs and voice messages, scored field by fieldModules 2, 6 and 10
13Deployment, Operations, and EconomicsA gateway with fallback, caching, quotas, a web service, tracing, a rollback planModules 2, 6 and 10
14Applications, Patterns, and FrontiersReview placement, feedback capture, a limitations memoModules 10 and 11
15CapstoneOne of four tracks, with shared evidence requirementsThe modules your track builds on

Where other courses go deeper

This course stays on the model's side of each subject. For depth elsewhere:

  • How the transformer inside the model works, layer by layer: the Transformers course and Module 6 of the AI Engineering course.
  • Retrieval pipelines (chunking, embeddings, hybrid search, reranking): the RAG course. Module 7 here covers only how much retrieved text to put in the context, and in what order.
  • Agents that act unattended, with durable state and deployment: the Agentic AI Engineer course.
  • Web services, databases and deployment as general engineering: Modules 10 to 13 of the AI Engineering course.

How each lesson works

Every lesson is a walk through one Quillpath example, one picture at a time:

  1. The situation: a specific problem at the support desk.
  2. A real case, first: something that really happened, from a published source, cited.
  3. The idea: fifteen to thirty figures, one idea each, one running example.
  4. Run it: code with a walkthrough of every line.
  5. Break it: a failure you cause on purpose.
  6. In production: what teams do with this at scale.
  7. Check yourself: questions, one exercise, key terms and sources.

Each module ends with a lab (a guided piece of the support desk) and an incident file (a real, published failure replayed at Quillpath and fixed). Every output shown in the course comes from a real run. More detail: course-guide/01-how-this-course-works.md.

The tools you will use

Python throughout. LangChain for calling models and tools and LangGraph for loops and approvals, so the same code works with Groq, Gemini or Ollama. PyTorch and Hugging Face transformers and peft where you open up or adapt a model; tiktoken for counting tokens; rank_bm25 for search; the official MCP SDK for tools; FastAPI and Docker for the service. Everything is open source apart from the hosted model services.

Course guide

FileRead it when
01-how-this-course-works.mdBefore your first lesson
02-setup-colab-and-llm-providers.mdBefore you run any code
03-the-quillpath-support-desk.mdTo meet the company, the people, the rules, the dates and the problem
06-shared-data.mdTo see the Quillpath data every module reuses
04-style-guide.mdOnly if you are writing or editing lessons
05-image-style-guide.mdOnly if you are drawing the course figures

The one measure

How often is the assistant right, how do you know, and what happens when it is wrong? Almost everything in this course exists to answer those three questions with numbers.