Where this topic leads

Topics that build on Markov Decision Processes

Once you have Markov Decision Processes, these are the topics that cite it as a prerequisite. Pick by tier and the area you want to push into next.

Editor's suggested next (2)

Core flagship topics (5)

Bellman Equationslayer 2 · rl-theory
Policy Gradient Theoremlayer 3 · rl-theory
Reward Design and Reward Misspecificationlayer 3 · rl-theory
The Era of Experiencelayer 4 · methodology
Value Iteration and Policy Iterationlayer 2 · rl-theory

Standard topics (10)

Agentic RL and Tool Uselayer 5 · rl-theory
Exploration vs Exploitationlayer 2 · rl-theory
Markov Games and Self-Playlayer 3 · rl-theory
Model-Based Reinforcement Learninglayer 3 · rl-theory
Multi-Agent Collaborationlayer 4 · rl-theory
Policy Representationslayer 3 · rl-theory
RLHF and Alignmentlayer 4 · llm-construction
Self-Play and Multi-Agent RLlayer 3 · rl-theory
Temporal Difference Learninglayer 2 · rl-theory
World Models and Planninglayer 4 · beyond-llms

Advanced or specialty topics (8)

Active SLAM and POMDPslayer 4 · applied-math
Mean-Field Gameslayer 4 · rl-theory
Options and Temporal Abstractionlayer 3 · rl-theory
Reinforcement Learning Environments and Benchmarkslayer 3 · rl-theory
Reinforcement Learning for Drug Discoverylayer 4 · applied-ml
Reinforcement Learning for Synthesis Planninglayer 4 · applied-ml
Reward Systems and Reinforcement Learning Neurosciencelayer 4 · applied-ml
Robust Adversarial Policieslayer 4 · rl-theory