Id: arxiv/2607.16538 Url: https://arxiv.org/abs/2607.16538 Tags: math.OC Score: 0 Title: History-Dependent Recursive Preferences in Markov Decision Processes Domain: math.OC Source: arxiv Authors: William B. Haskell Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-17 Page: https://delphi.science/r/arxiv/2607.16538 In finite horizon dynamic programming with history-dependent preferences, the relevant state may be the entire realized history, even when the physical state is Markov. This paper develops a behavioral state-reduction theory for such Markov decision processes. Under behavioral axioms and a certainty-equivalent richness condition, the full-history problem admits a recursive representation composed of time and risk aggregators. We then derive a canonical preference-augmented (PA) state by quotienting histories that have the same current physical Markov state, are indifferent under every common…