{"id":"arxiv/2611.15300","url":"https://arxiv.org/abs/2611.15300","tags":["cs.LG","math.ST","stat.ML"],"score":0,"title":"Sharp Covering-Number Bounds for Feedforward ReLU Networks via Parameter Symmetries","domain":"cs.LG","source":"arxiv","authors":["Ruizhi Deng","Guohao Shen","Tangrui Xiong"],"reviews":0,"subject":"cs.LG","summary":"In neural networks, distinct parameter configurations often realize the same input--output mapping, indicating that nominal parameter counts can overstate functional complexity. In this paper, we characterize the parameter-space symmetries of ReLU and Leaky ReLU networks across fully connected, convolutional, and residual architectures. We prove that every quasianalytic parameter map preserving the network function is a composition of positive channel scaling and channel permutation. By quotienting out both symmetries, we derive uniform covering-number upper bounds in which positive scaling…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-11","reactions":{}}