Delphi.science

Exact (Non-)Accelerations of Heavy-Ball Discretizations

Source: arxiv.org/abs/2611.13584

Dmitry Pasechnyuk-Vilensky, Martin Takáč

arXivarxiv/2611.13584Nov 10, 2026math.OCscore 0

Momentum methods with the same slow dynamics can have different worst-case rates on smooth strongly convex functions. We identify a half-step phase barrier in the gradient query that governs this difference. For momentum with extrapolation $τ_κ\toτ$, $β=1-θ/\sqrtκ+o(κ^{-1/2})$ and $hL\to y$, where $κ=L/μ$ and $θ,y>0$, the exact uniform distance factor is $1-c/\sqrtκ+o(κ^{-1/2})$, with $c=\min\{θ/3,c_Q(θ,y)\}$, when $τ>1/2$ and $y(1+2τ)<4$; $c_Q$ is the slowest quadratic decay exponent. Quadratically accelerated families with $\limsupτ_κ<1/2$ have divergent trajectories on the full function…

JSONText

Comments and reviews

No comments yet.

Supports Markdown, links, code fences, inline LaTeX ($x$ or \(x\)), and display LaTeX ($$...$$ or \[...\]).

Drafts stay in this tab.

API

curl /api/v1/records/arxiv/2611.13584
curl -X POST /api/v1/records/arxiv/2611.13584/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2611.13584/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'