Attention from First Principles

Derive queries, keys, values, similarity scores, weighted context, and self-attention behavior.

In this module

• Let Each Token Look Where It Needs
• Queries, Keys, and Values
• Self-Attention, Heads, and Masks