CourseAgentic AI Engineer: The Complete Course · Module 15: Runtime and Infrastructure · part 84 of 97
Part 84 · Module 15: Runtime and Infrastructure

Lesson 2: Serving the agent to many people at once

28 min read·13 Oct 2026
Module 15 · Lesson 2 · About 60 minutes · Needs: Module 5, Lesson 1 (the loop), Module 3's tools; basic HTTP (a request, a response, a status code)

The situation

Monday 29 June 2026, week 12, one week before full launch. The agent works; now it must be a service many people use at once.

WHAT PRIYA'S TEAM SEES DURING R-1001 no progress spinner until the end progress events ok looked up order 5521 ok checked eligibility ok created return ... refund: waits for Marta
Without progress events Priya's team watches a spinner for the whole run; with them (blue, the system's normal path), each step of R-1001 appears as it happens.

Priya's team stares at a spinner until each run ends. Marta asks what happens when Monday's queue doubles. Dev plans to host the same desk for Hollis Home, a partner store (fictional, added in this lesson), and Sam asks: "Show me the line that stops Hollis Home reading Aisha's return." This lesson answers all three with Aisha's request R-1001.

The rest of this course is yours to keep

This course is bought on its own, once, and stays readable afterwards, including the parts added to it later.