{"id":"arxiv/2611.11387","url":"https://arxiv.org/abs/2611.11387","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Orthogonal Updates for the Win: Towards Accelerated Adaptive Minimax Optimization","domain":"cs.LG","source":"arxiv","authors":["Zhiwei Zhai","Xinyu Wang","Wenjing Yan","Lei Ding","Ying-Jun Angela Zhang"],"reviews":0,"subject":"cs.LG","summary":"Single-loop minimax methods are appealing for modern machine learning, but standard stochastic gradient updates can be unstable and oscillatory under tightly coupled primal-dual dynamics, making performance notoriously sensitive to stepsizes. To fundamentally improve stability, we develop an orthogonal update framework tailored to minimax optimization, which applies updates along orthogonalized directions to reduce update anisotropy. However, orthogonalization reshapes the optimization geometry and makes coordinating primal-dual stepsizes even more delicate. To overcome this challenge, we…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-08","reactions":{}}