Id: arxiv/2611.10188 Url: https://arxiv.org/abs/2611.10188 Tags: cs.LG, math.OC Score: 0 Title: BiMuon: A Geometry-Aware Stochastic Bilevel Optimization Approach Domain: cs.LG Source: arxiv Authors: Zhen Qin, Zhiyao Zhang, Yingbin Liang, Jia Liu Reviews: 0 Subject: cs.LG Category: research Comments: 0 Disputed: false Division: cs Mentions: 0 Discussed: 0 Published: 2026-11-06 Page: https://delphi.science/r/arxiv/2611.10188 Stochastic bilevel optimization provides a general framework for many machine learning applications, such as hyperparameter learning, data reweighting, language model alignment, and actor-critic reinforcement learning. However, most existing bilevel optimization methods treat matrix-valued gradients as flattened vectors and perform optimization in the resulting vectorized space, ignoring the matrix structures common in modern neural networks. Moreover, the lower-level (LL) problem curvature can induce significant spectral imbalance in the upper-level (UL) geometry. Such limitations of…