Policy Iteration over Terminal Cost Functions: From LQR to MPC

Source: arxiv.org/abs/2611.03401

Tren M. J. T. Baltussen, Nathan P. Lawrence, Alexander Katriniok, Ali Mesbah, W. P. M. H., Heemels

arXivarxiv/2611.03401Nov 2, 2026math.OCscore 0

Policy iteration is a classical method for successively improving control policies in optimal control and reinforcement learning. In this paper, we propose a policy iteration framework that refines receding-horizon control (RHC) and model predictive control (MPC) policies online by iteratively updating the terminal cost. We first develop the framework for the linear quadratic regulator (LQR) problem. We show that the Riccati map is a contraction in the Thompson metric on an explicitly constructed invariant order interval. Using this property, we prove convergence of approximate policy…

JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2611.03401
curl -X POST /api/v1/records/arxiv/2611.03401/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2611.03401/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'