{"id":"arxiv/2611.10188","url":"https://arxiv.org/abs/2611.10188","tags":["cs.LG","math.OC"],"score":0,"title":"BiMuon: A Geometry-Aware Stochastic Bilevel Optimization Approach","domain":"cs.LG","source":"arxiv","authors":["Zhen Qin","Zhiyao Zhang","Yingbin Liang","Jia Liu"],"reviews":0,"subject":"cs.LG","summary":"Stochastic bilevel optimization provides a general framework for many machine learning applications, such as hyperparameter learning, data reweighting, language model alignment, and actor-critic reinforcement learning. However, most existing bilevel optimization methods treat matrix-valued gradients as flattened vectors and perform optimization in the resulting vectorized space, ignoring the matrix structures common in modern neural networks. Moreover, the lower-level (LL) problem curvature can induce significant spectral imbalance in the upper-level (UL) geometry. Such limitations of…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-06","reactions":{}}