Id: arxiv/2611.17736 Url: https://arxiv.org/abs/2611.17736 Tags: math.OC, math.NA Score: 0 Title: High-probability convergence of adaptive, proximal, and clipped Adam-type methods for nonconvex stochastic optimization Domain: math.OC Source: arxiv Authors: Xiaopeng Zhu, Zhongyi Huang Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-11-13 Page: https://delphi.science/r/arxiv/2611.17736 This paper develops a unified high-probability analysis of adaptive, proximal, and clipped first-order methods for nonconvex stochastic optimization. For a smooth objective whose stochastic gradient error has sub-Gaussian norm, the normalized adaptive gradient method attains the standard stochastic nonconvex complexity of the square root of the number of iterations, with an additional logarithmic dependence on the inverse confidence level that is inversely proportional to the number of iterations. The proof uses an adaptive descent decomposition together with Freedman and Bernstein…