Interactive Demos
Build intuition by playing with the math. Every demo runs in your browser with zero setup. Sliders, toggles, and live animations.
Featured
Optimizer Race
Race SGD vs Momentum vs Adam on real loss surfaces. Watch them converge in real time.
Interactive (sliders and controls)
Bias-Variance Tradeoff
Drag the complexity slider. Watch the polynomial fit change. See train and test error diverge.
Softmax Temperature
Slide temperature from 0.1 to 10. Watch the probability distribution sharpen or flatten.
Dropout Visualization
Toggle dropout on and off. Watch neurons mask and rescale by 1/(1-p).
Gradient Descent Contours
The full optimizer race embedded in the convex optimization theory page.
Distribution Explorer
Slide parameters of Gaussian, Bernoulli, Poisson. Watch PDF and CDF change.
MLE Likelihood Surface
Add data points. Watch the likelihood surface shift. See the MLE move.
Learning Rate Schedules
Compare cosine decay, step decay, warmup, and constant LR side by side.
Activation Functions
ReLU, GELU, SiLU (Swish), tanh. See the function and its derivative simultaneously.
Hessian Curvature
Visualize curvature at different points on a loss surface. See where saddle points live.
Fat Tail Comparison
Gaussian vs Cauchy vs Student-t. See how tail heaviness changes concentration behavior.
Induction Head Circuit
Visualize the two-layer attention circuit that enables in-context learning.
Teaching Diagrams
RLHF Pipeline
SFT, reward model, PPO flow
Kalman Filter
Predict-update cycle
Gibbs Sampling
Variable cycling + staircase trajectory
Fisher Information
Log-likelihood curvature
Hypothesis Classes
Linear vs polynomial vs neural net boundaries
Implicit Bias
GD on interpolation manifold
Joint Distribution
2D scatter with marginals
Rademacher Complexity
Random labels + class correlation
PAC Learning
Sample complexity curves
Measure Theory
Sigma-algebra Venn diagram
SGD Convergence
O(1/T) vs O(1/sqrt(T)) comparison
Optimizer Comparison
SGD/Momentum/Adam/Muon update rules
89 diagram components across 491 topic pages. Browse all topics