Skip to main content

Prerequisite chain

Prerequisites for Flash Attention

Topics you need before working through Flash Attention. Direct prerequisites are listed first; transitive prerequisites (the chain reachable through them) follow.

Direct prerequisites (2)

  1. Attention Mechanism Theorylayer 4, tier 2
  2. Softmax and Numerical Stabilitylayer 1, tier 1

Reachable through the chain (3)

These topics are not directly cited as prerequisites but are reached transitively by following the chain upward. Working through the direct prerequisites pulls these in.