{"id":"arxiv/2611.14811","url":"https://arxiv.org/abs/2611.14811","tags":["stat.ML","cs.LG","math.OC"],"score":0,"title":"Improved last-iterate bounds for SGD with and without replacement","domain":"stat.ML","source":"arxiv","authors":["Yimin Zhong","Jiaxin Zhou"],"reviews":0,"subject":"stat.ML","summary":"In this work, we study last-iterate convergence bounds for stochastic gradient descent (SGD) on convex and $β$-smooth loss functions and improve the bound from $\\cO((\\log T)^3/T)$ to $\\cO((\\log T)^3/(T\\log\\log T))$ in the interpolation regime. The improvement comes from applying a horizon-dependent multiscale estimate of gradients to the comparison of trajectories. The bound applies to both sampling with replacement and sampling without replacement within one pass.","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-11-10","reactions":{}}