Id: arxiv/2611.24988 Url: https://arxiv.org/abs/2611.24988 Tags: stat.ML, cs.LG, math.PR Score: 0 Title: Variance-Adaptive Upper Confidence Bounds for Multi-Armed Bandits with Kaplan--Meier Survival Estimation Domain: stat.ML Source: arxiv Authors: Yangfan Cui, Andrew Papanicolaou Reviews: 0 Subject: stat.ML Category: research Comments: 0 Disputed: false Division: stat Mentions: 0 Discussed: 0 Published: 2026-11-18 Page: https://delphi.science/r/arxiv/2611.24988 We study the stochastic multi-armed bandit problem in which the reward associated with each arm is the survival probability at a pre-specified time horizon, and the observed outcome is a right-censored time-to-event variable. Standard bandit algorithms face delayed and partial observations in this setting. Prior adaptations for the Kaplan--Meier (KM) estimator rely on Hoeffding-type bounds that ignore the inherent heteroscedasticity of continuous survival processes. To bridge this gap, we propose KM-UCB, a variance-adaptive policy that unites continuous-time survival analysis with discrete…