Where this topic leads

Topics that build on Feedforward Networks and Backpropagation

Once you have Feedforward Networks and Backpropagation, these are the topics that cite it as a prerequisite. Pick by tier and the area you want to push into next.

Editor's suggested next (3)

Core flagship topics (8)

Batch Normalizationlayer 2 · training-techniques
Dropoutlayer 2 · training-techniques
Fine-Tuning and Adaptationlayer 3 · llm-construction
Gradient Flow and Vanishing Gradientslayer 2 · optimization-function-classes
Linear Layer: Shapes, Bias, and Memorylayer 2 · llm-construction
Skip Connections and ResNetslayer 2 · ml-methods
Universal Approximation Theoremlayer 2 · ml-methods
Weight Initializationlayer 2 · training-techniques

Standard topics (17)

Activation Checkpointinglayer 3 · training-techniques
Adversarial Machine Learninglayer 4 · ai-safety
Autoencoderslayer 2 · ml-methods
Contrastive Learninglayer 3 · ml-methods
Convolutional Neural Networkslayer 3 · ml-methods
Generative Adversarial Networkslayer 3 · ml-methods
Iterative Magnitude Pruning and the Lottery Ticket Hypothesislayer 4 · llm-construction
Knowledge Distillationlayer 3 · llm-construction
Kolmogorov-Arnold Networks (KANs)layer 4 · beyond-llms
Meta-Learninglayer 3 · ml-methods
Model Compression and Pruninglayer 3 · llm-construction
Optimal Brain Surgeon and Pruning Theorylayer 3 · ml-methods
Physics-Informed Neural Networkslayer 4 · beyond-llms
Recurrent Neural Networkslayer 3 · ml-methods
Token Prediction and Language Modelinglayer 3 · llm-construction
Transfer Learninglayer 3 · ml-methods
Transformer Architecturelayer 4 · llm-construction

Advanced or specialty topics (8)

Bayesian Neural Networkslayer 3 · ml-methods
Energy-Based Modelslayer 3 · ml-methods
Hebbian Learninglayer 4 · applied-ml
Mixture Density Networkslayer 3 · ml-methods
Neural Architecture Searchlayer 4 · llm-construction
Occupancy Networks and Neural Fieldslayer 4 · beyond-llms
Quantization Theorylayer 5 · llm-construction
Spiking Neural Networkslayer 4 · applied-ml