Topic 7: Online Evaluation

Intuition: offline evaluation asks "is this better on our questions?". Online evaluation asks "is this better for real users, right now?". You need both: offline catches regressions before release, online catches what your questions never covered.

7.1 Click, Dwell, Thumbs, Copy, and Escalation Signals