Id: arxiv/2606.29206 Url: https://arxiv.org/abs/2606.29206 Tags: math.OC, math.CA, math.NA Score: 0 Title: Modern Theory of Gradient-Based Optimization Domain: math.OC Source: arxiv Authors: Bin Shi Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-06-28 Page: https://delphi.science/r/arxiv/2606.29206 In this review, we offer a comprehensive survey of emerging techniques in gradient-based optimization, with a particular emphasis on the interplay between ordinary differential equation (ODE) perspectives and their extensions into discrete Lyapunov analysis. We begin by examining the acceleration mechanisms underlying Nesterov's accelerated gradient method for strongly convex functions (NAG-SC) and Polyak's heavy-ball method, identifying the gradient-correction term as the primary driver of acceleration. This mechanistic insight is substantiated through high-resolution ODE modeling and the…