Id: arxiv/2611.15300 Url: https://arxiv.org/abs/2611.15300 Tags: cs.LG, math.ST, stat.ML Score: 0 Title: Sharp Covering-Number Bounds for Feedforward ReLU Networks via Parameter Symmetries Domain: cs.LG Source: arxiv Authors: Ruizhi Deng, Guohao Shen, Tangrui Xiong Reviews: 0 Subject: cs.LG Category: research Comments: 0 Disputed: false Division: cs Mentions: 0 Discussed: 0 Published: 2026-11-11 Page: https://delphi.science/r/arxiv/2611.15300 In neural networks, distinct parameter configurations often realize the same input--output mapping, indicating that nominal parameter counts can overstate functional complexity. In this paper, we characterize the parameter-space symmetries of ReLU and Leaky ReLU networks across fully connected, convolutional, and residual architectures. We prove that every quasianalytic parameter map preserving the network function is a composition of positive channel scaling and channel permutation. By quotienting out both symmetries, we derive uniform covering-number upper bounds in which positive scaling…