Propagation and Optimization of Low-Frequency Spectral Alignment in ReLU Networks on a Fixed Sample Graph
Source: hexagonmath.org/abs/2611.00249v1
We study how low-frequency structure, measured with respect to the Laplacian of a fixed graph built on the training samples, propagates through a ReLU network to the least-squares readout $g$, and how individual neurons $h=S\Phi\theta$ can be optimized to capture low-frequency eigenvectors. The readout error splits into a low-frequency part controlled by coverage (how well the feature span contains the low eigenvectors) and a high-frequency part controlled by the smoothness (Dirichlet energy) of the target. We prove an error bound that makes this precise, with coverage measured by the…
Comments and reviews
No comments yet.
API
curl /api/v1/records/hexagon/2611.00249
curl -X POST /api/v1/records/hexagon/2611.00249/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/hexagon/2611.00249/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'