Topic 2: Dense Retrieval

2.1 Bi-Encoder Architecture and the Approximation It Makes

Intuition: a bi-encoder writes a one-line summary card for every document in advance, and one for the question when it arrives, then compares cards. It never reads the question and the document together.