{"id":"arxiv/2611.15291","url":"https://arxiv.org/abs/2611.15291","tags":["cs.LG","math.OC"],"score":0,"title":"Learning Rate Transfer and Feature Learning Across Depth for Constrained Spectral Optimizers: Complete Scion","domain":"cs.LG","source":"arxiv","authors":["Eline Pot","Laurent Lefebvre","Mathieu Segond","Antonio Silveti-Falls"],"reviews":0,"subject":"cs.LG","summary":"Hyperparameter transfer across model depth is instrumental in training deep models, as it enables learning rates calibrated on shallow networks to be effectively applied to deeper architectures. The recent CompleteP framework establishes a $1/L$ residual scaling rule that demonstrates this for Adam-family optimizers. We study whether similar transfer extends to constrained optimization methods, specifically Frank-Wolfe and projected non-Euclidean normalized steepest descent, where updates are determined by linear minimization oracles. We derive scaling rules for these methods which confirm…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-11","reactions":{}}