Id: arxiv/2603.00945 Url: https://arxiv.org/abs/2603.00945 Tags: math.OC, cs.LG, stat.ML Score: 0 Title: Non-Rectangular Average-Reward Robust MDPs: Optimal Policies and Their Transient Values Domain: math.OC Source: arxiv Authors: Shengbo Wang, Nian Si Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-03-01 Page: https://delphi.science/r/arxiv/2603.00945 We study non-rectangular robust Markov decision processes under the average-reward criterion, where the ambiguity set couples transition probabilities across states and the adversary commits to a stationary kernel for the entire horizon. We show that any history-dependent policy achieving sublinear expected regret uniformly over the ambiguity set is robust-optimal, and that the robust value admits a minimax representation as the infimum over the ambiguity set of the classical optimal gains, without requiring any form of rectangularity or robust dynamic programming principle. Under the weak…