Id: arxiv/2603.13155 Url: https://arxiv.org/abs/2603.13155 Tags: math.OC Score: 0 Title: Reinforcement Learning for Discounted and Ergodic Control of Diffusion Processes Domain: math.OC Source: arxiv Authors: Erhan Bayraktar, Ali D. Kara, Somnath Pradhan, Serdar Yuksel Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-03-13 Page: https://delphi.science/r/arxiv/2603.13155 This paper develops a quantized Q-learning algorithm for the optimal control of controlled diffusion processes on $\mathbb{R}^d$ under both discounted and ergodic (average) cost criteria. We first establish near-optimality of finite-state MDP approximations to discrete-time discretizations of the diffusion, then introduce a quantized Q-learning scheme and prove its almost-sure convergence to near-optimal policies for the finite MDP. These policies, when interpolated to continuous time, are shown to be near-optimal for the original diffusion model under discounted costs and -- via a…