{"id":"arxiv/2611.10700","url":"https://arxiv.org/abs/2611.10700","tags":["cs.LG","math.NA"],"score":0,"title":"Spectral Bias Reduction in Local Gated ReLU Architectures","domain":"cs.LG","source":"arxiv","authors":["Victorita Dolean"],"reviews":0,"subject":"cs.LG","summary":"Neural networks trained by gradient-based methods learn the low-frequency content of a target function faster than its high-frequency content. This spectral bias is well documented, but it is much less clear which architectural choices mitigate it and which cannot. We study the question for shallow ReLU models linear in their trainable parameters, where each mode is learned at a rate given by a Gram-matrix eigenvalue, and for a general symmetric bilinear form $a(\\cdot,\\cdot)$, so that least-squares regression ($a=$ the $L^2$ inner product) and variational or physics-informed losses ($a=$ the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-07","reactions":{}}