Prerequisite chain
Prerequisites for Efficient Transformers Survey
Topics you need before working through Efficient Transformers Survey. Direct prerequisites are listed first; transitive prerequisites (the chain reachable through them) follow.
Direct prerequisites (1)
- Attention Variants and Efficiencylayer 4, tier 2
Reachable through the chain (5)
These topics are not directly cited as prerequisites but are reached transitively by following the chain upward. Working through the direct prerequisites pulls these in.
- Attention Mechanism Theorylayer 4, tier 2
- Matrix Operations and Propertieslayer 0A, tier 1
- Sets, Functions, and Relationslayer 0A, tier 1
- Basic Logic and Proof Techniqueslayer 0A, tier 2
- Softmax and Numerical Stabilitylayer 1, tier 1