Id: arxiv/2606.21925 Url: https://arxiv.org/abs/2606.21925 Tags: math.OC Score: 0 Title: PhiBE-Q-Learning: Bridging Off-Policy Reinforcement Learning and Continuous-Time Control Domain: math.OC Source: arxiv Authors: Yuhua Zhu Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-06-20 Page: https://delphi.science/r/arxiv/2606.21925 In this paper, we develop an off-policy method for continuous-time reinforcement learning (CTRL), where the system dynamics are governed by an unknown stochastic differential equation (SDE) and only discrete-time trajectory data are available. A central challenge is that the classical discrete-time state--action value function loses its action-dependent signal in the continuous-time limit (Baird, 1994; Jia and Zhou, 2023; Tallec et al., 2019). On the other hand, continuous-time control provides local notions such as the instantaneous advantage function $q(s,a)$, but these typically rely on…