arXiv stat.ML
· Papers
Model-based Bootstrap of Controlled Markov Chains
arXiv:2605.12410v2 Announce Type: replace Abstract: We propose and analyze a model-based bootstrap for transition kernels in finite controlled Markov chains (CMCs) with possibly nonstationary or history-dependent control policies, a setting that arises naturally in offline reinforcement learning (RL) when the behavior