Id: arxiv/2611.11526 Url: https://arxiv.org/abs/2611.11526 Tags: cs.LG, math.OC, stat.ML Score: 0 Title: A Stability Analysis of AdamW: Unstable Equilibria and Non-Convergence Domain: cs.LG Source: arxiv Authors: Baiyu Su, Lizhang Chen, Qiang Liu Reviews: 0 Subject: cs.LG Category: research Comments: 0 Disputed: false Division: cs Mentions: 0 Discussed: 0 Published: 2026-11-08 Page: https://delphi.science/r/arxiv/2611.11526 AdamW is ubiquitous in deep learning, yet its behavior remains poorly understood. We analyze its dynamics through the lens of dynamical systems and show that AdamW admits an implicit fixed-point objective: its fixed points coincide with the stationary points of a constrained and regularized optimization problem. However, not all of these fixed points are stable under AdamW's dynamics, and stability depends sensitively on curvature, weight decay, and momentum parameters. Even in one-dimensional settings, equilibria may be unstable, and trajectories can exhibit persistent oscillations rather…