{"id":"arxiv/2611.12663","url":"https://arxiv.org/abs/2611.12663","tags":["math.OC"],"score":0,"title":"Multi-objective Markov Decision Process: Set-valued Bellman's principle and fixed point perspective","domain":"math.OC","source":"arxiv","authors":["Zachary Feinstein","Gabriela Kováčová","Ariel Neufeld","Birgit Rudloff"],"reviews":0,"subject":"math.OC","summary":"We study infinite-horizon discounted Markov decision processes with multiple cost objectives and finite state and action spaces. We consider the set of value functions generated by randomized Markov policies, where each function describes the expected discounted costs from all initial states under a single policy. We establish a set-valued Bellman equation and characterize this set as the greatest fixed point of the associated Bellman operator. We also show that choosing an attainable cost vector separately for each initial state can produce a function that no single Markov policy realizes.…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-11-09","reactions":{}}