Id: arxiv/2606.27610 Url: https://arxiv.org/abs/2606.27610 Tags: math.OC Score: 0 Title: Policy Gradient Learning for Distributionally Robust Markov Decision Processes under Wasserstein Ambiguity Domain: math.OC Source: arxiv Authors: Yadh Hafsi, Samy Mekkaoui, Huyên Pham, Kaixin Yan Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-06-25 Page: https://delphi.science/r/arxiv/2606.27610 We study finite-horizon Markov decision processes under distributional uncertainty in the transition kernels and develop a policy-gradient framework for Wasserstein distributionally robust control. Ambiguity is modeled by Wasserstein balls of common radius centered at state--action-dependent nominal transition kernels, leading to a max--min problem over randomized policies and admissible transition laws. Because the worst-case transition law depends implicitly on the policy parameters, the standard policy-gradient argument does not apply directly. We address this difficulty by combining the…