Unlock: Tabular Foundation Models as Bayesian Inference Engines

Prior-data fitted networks are transformers pre-trained on datasets drawn from a prior, then used as amortized Bayesian inference engines at test time with no gradient updates. TabPFN is the canonical instance. The right comparison is not to XGBoost. It is to MCMC.