Id: arxiv/2602.08177 Url: https://arxiv.org/abs/2602.08177 Tags: math.OC Score: 0 Title: Implicit regularization of normalized gradient descent Domain: math.OC Source: arxiv Authors: Cédric Josz Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-09 Page: https://delphi.science/r/arxiv/2602.08177 How to find flat minima? We propose running normalized gradient descent, usually reserved for nonsmooth optimization, with sufficiently slowly diminishing step sizes. This induces implicit regularization towards flat minima if an appropriate Lyapunov functions exists in the gradient dynamics. Our analysis shows that implicit regularization is intrinsically a question of nonsmooth analysis, for which we deploy the full power of variational analysis and stratification theory.