Id: arxiv/2606.29893 Url: https://arxiv.org/abs/2606.29893 Tags: math.OC, stat.ML Score: 0 Title: AdaGrad does not adapt to Hölder-smoothness for composite objectives Domain: math.OC Source: arxiv Authors: Matia Bojovic, Saverio Salzo, Massimiliano Pontil Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-06-29 Page: https://delphi.science/r/arxiv/2606.29893 We exhibit a simple deterministic one-dimensional convex composite optimization problem for which AdaGrad scheme does not achieve the classical convergence rate $\mathcal{O}(n^{-(1+ν)/2})$ associated with Hölder-smooth objectives. The example highlights a basic mismatch between classical AdaGrad accumulation and composite optimality. A main insight is that the gradient of the smooth term may not vanish at the optimum, causing AdaGrad to keep reducing its stepsize excessively and converge more slowly. We also discuss why alternative accumulation mechanisms based on gradient mappings or on…