Id: arxiv/2602.06175 Url: https://arxiv.org/abs/2602.06175 Tags: math.ST, cs.AI, cs.LG, stat.ML Score: 0 Title: Optimal rates for density and mode estimation with expand-and-sparsify representations Domain: math.ST Source: arxiv Authors: Kaushik Sinha, Christopher Tosh Reviews: 0 Subject: math.ST Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-05 Page: https://delphi.science/r/arxiv/2602.06175 Expand-and-sparsify representations are a class of theoretical models that capture sparse representation phenomena observed in the sensory systems of many animals. At a high level, these representations map an input $x \in \mathbb{R}^d$ to a much higher dimension $m \gg d$ via random linear projections before zeroing out all but the $k \ll m$ largest entries. The result is a $k$-sparse vector in $\{0,1\}^m$. We study the suitability of this representation for two fundamental statistical problems: density estimation and mode estimation. For density estimation, we show that a simple linear…