Id: arxiv/2611.14463 Url: https://arxiv.org/abs/2611.14463 Tags: stat.ML, cs.LG, math.ST Score: 0 Title: A Theory of Cross-Validation Variance Domain: stat.ML Source: arxiv Authors: Nathaniel S. O'Connell, Jaime L. Speiser Reviews: 0 Subject: stat.ML Category: research Comments: 0 Disputed: false Division: stat Mentions: 0 Discussed: 0 Published: 2026-11-10 Page: https://delphi.science/r/arxiv/2611.14463 Cross-validation estimates predictive performance by repeatedly splitting the data into training and validation sets, fitting the model on the first and evaluating it on the second. Every observation influences the estimate in two roles, through its own evaluation when it is held out and through the models it helps fit when it trains. The random splits determine its weight in each role. From this representation, we prove an exact finite-sample identity for the variance of the cross-validated estimate. For a given splitting scheme with a common training set size, the variance is a function of…