{"id":"arxiv/2611.11526","url":"https://arxiv.org/abs/2611.11526","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"A Stability Analysis of AdamW: Unstable Equilibria and Non-Convergence","domain":"cs.LG","source":"arxiv","authors":["Baiyu Su","Lizhang Chen","Qiang Liu"],"reviews":0,"subject":"cs.LG","summary":"AdamW is ubiquitous in deep learning, yet its behavior remains poorly understood. We analyze its dynamics through the lens of dynamical systems and show that AdamW admits an implicit fixed-point objective: its fixed points coincide with the stationary points of a constrained and regularized optimization problem. However, not all of these fixed points are stable under AdamW's dynamics, and stability depends sensitively on curvature, weight decay, and momentum parameters. Even in one-dimensional settings, equilibria may be unstable, and trajectories can exhibit persistent oscillations rather…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-08","reactions":{}}