Id: arxiv/2607.24041 Url: https://arxiv.org/abs/2607.24041 Tags: math.ST, cs.LG, stat.ML Score: 0 Title: The Zero Pattern of a Design Matrix Drives Multiple Descent in Over-parameterized Regression Domain: math.ST Source: arxiv Authors: Kevin Han Huang, Haoyu Ye, Somak Laha, Morgane Austern Reviews: 0 Subject: math.ST Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-27 Page: https://delphi.science/r/arxiv/2607.24041 Over-parameterized linear regression has been widely studied over the last decade. However, most existing works assume that the covariates are independent and that their covariance matrices are non-degenerate. In this paper, we relax both assumptions and derive deterministic equivalents for the prediction risk in a vanishing-ridge regime. We show that degeneracy of the covariance matrices and dependence can lead to multiple descent, and characterize where the corresponding peaks can occur. Our proofs use a novel graph representation of the variance profile. We show that maximum matchings and…