Transformers. Connect the ideas.

Start with the big picture: four tokens, two attention heads and eleven connected steps.

The multi-head attention walkthrough includes numerical examples, an interactive, narration and thinking questions. It is part of the premium collection.

Planned foundation mini lessons cover tokens and embeddings, matrix multiplication, dot products, softmax, weighted averages and causal masking.