Skip to main content

Prerequisite chain

Prerequisites for Bits, Nats, Perplexity, and BPB

Topics you need before working through Bits, Nats, Perplexity, and BPB. Direct prerequisites are listed first; transitive prerequisites (the chain reachable through them) follow.

Direct prerequisites (2)

  1. Information Theory Foundationslayer 0B, tier 2
  2. KL Divergencelayer 1, tier 1

Reachable through the chain (3)

These topics are not directly cited as prerequisites but are reached transitively by following the chain upward. Working through the direct prerequisites pulls these in.