Id: arxiv/2607.17090 Url: https://arxiv.org/abs/2607.17090 Tags: math.AG, cs.NE Score: 0 Title: Expressivity of Shallow Neural Networks Over Finite Fields Domain: math.AG Source: arxiv Authors: Maksym Zubkov, Carol Wu, Shiwei Yang, Param Mody, Yifei Chen Reviews: 0 Subject: math.AG Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-19 Page: https://delphi.science/r/arxiv/2607.17090 We study the expressivity of shallow polynomial neural networks (PNNs) with monomial activation functions over finite fields. For a given architecture, we define a neuromanifold as the image of the map from all possible network weights into the product of polynomial rings. We quantify the expressivity by the cardinality of the neuromanifold, and derive a natural lower and upper bound. This leads to counting rational points over finite fields, a problem closely linked to the Weil conjectures. Finally, we present an architecture that exhibits a striking difference in the neuromanifolds when…