Id: arxiv/2601.16842 Url: https://arxiv.org/abs/2601.16842 Tags: math.ST, stat.ML Score: 0 Title: Parametric Mean-Field empirical Bayes in high-dimensional linear regression Domain: math.ST Source: arxiv Authors: Seunghyun Lee, Nabarun Deb Reviews: 0 Subject: math.ST Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-01-23 Page: https://delphi.science/r/arxiv/2601.16842 In this paper, we consider the problem of parametric empirical Bayes estimation of an i.i.d. prior in high-dimensional Bayesian linear regression, with random design. We obtain the asymptotic distribution of the variational Empirical Bayes (vEB) estimator, which approximately maximizes a variational lower bound of the intractable marginal likelihood. We characterize a sharp phase transition behavior for the vEB estimator -- namely that it is information theoretically optimal (in terms of limiting variance) up to $p=o(n^{2/3})$ while it suffers from a sub-optimal convergence rate in higher…