Id: arxiv/2602.06824 Url: https://arxiv.org/abs/2602.06824 Tags: math.OC, cs.LG Score: 0 Title: RanSOM: Second-Order Momentum with Randomized Scaling for Constrained and Unconstrained Optimization Domain: math.OC Source: arxiv Authors: El Mahdi Chayti, Mohamad Fakhouri Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-06 Page: https://delphi.science/r/arxiv/2602.06824 Second-order momentum corrects the lag of momentum behind the current gradient with a Hessian-vector product (HVP), but existing corrections need either a Lipschitz Hessian or extra forward and backward passes at an auxiliary point. We show that randomizing the step length removes this trade-off: if the step is exponentially distributed with mean $η$, a Stein-type identity makes $η$ times one HVP at the new iterate an estimate of the gradient change that is unbiased in expectation over the step, and this HVP shares its forward pass with the next gradient. The resulting method, RanSOM-E,…