{"id":"arxiv/2604.06039","url":"https://arxiv.org/abs/2604.06039","tags":["math.OC","cs.LG","math.PR"],"score":0,"title":"Value Mirror Descent for Reinforcement Learning","domain":"math.OC","source":"arxiv","authors":["Zhichao Jia","Guanghui Lan"],"reviews":0,"subject":"math.OC","summary":"Value iteration-type methods have been extensively studied for computing a nearly optimal value function in reinforcement learning (RL). Under a generative sampling model, these methods can achieve sharper sample complexity than policy optimization approaches, particularly in their dependence on the discount factor. In practice, they are often employed for offline training. In this paper, we consider discounted Markov decision processes with state space S, action space A, discount factor $γ\\in(0,1)$ and costs in $[0,1]$. We introduce a novel value optimization method, termed value mirror…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-04-07","reactions":{}}