{"id":"arxiv/2606.18440","url":"https://arxiv.org/abs/2606.18440","tags":["math.AG"],"score":0,"title":"Exceptional Singularities in Polynomial Neural Networks","domain":"math.AG","source":"arxiv","authors":["Giacomo Graziani"],"reviews":0,"subject":"math.AG","summary":"The singularities of a neurovariety have so far always turned out to lie at subnetworks: functions already computed by a smaller architecture of the same kind. This is what makes them readable as a bias of training towards simpler models, and whether they exhaust the singular locus is left open in the literature. We show that they do not. There are singular points at which every neuron is active, no two neurons are redundant, and the parametrisation is unramified, so that nothing visible at a single parameter signals the singularity. We call these exceptional, and we show that, after…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-06-16","reactions":{}}