Non-Euclidean Gradient Descent Has Many Edges of Stability
Recent observations that deep learning models train at the edge of stability have renewed interest in understanding stability properties of classical optimization algorithms. For quadratic objectives, standard gradient descent has a sharp stability threshold: it converges from every initialization when $η 2/L$, and diverges from every nonzero initialization when $η>2/μ$. For non-Euclidean gradient descent, the corresponding known guarantees are weaker: convergence holds for every initialization when $η 2/μ$. The behavior in the intermediate regime $2/S<η<2/μ$ is not fully characterized. We…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2610.15223
curl -X POST /api/v1/records/arxiv/2610.15223/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.15223/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'