Id: arxiv/2608.24592 Url: https://arxiv.org/abs/2608.24592 Tags: math.OC, stat.ME, stat.ML Score: 0 Title: Optimal Allocation of Embedding Dimensions under Finite-Sample Constraints Domain: math.OC Source: arxiv Authors: Vasileios E. Papageorgiou Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-08-25 Page: https://delphi.science/r/arxiv/2608.24592 The embedding dimension of categorical predictors is usually selected through heuristic tuning, although it directly affects model complexity, approximation quality, and finite-sample generalization. This paper formulates embedding dimension selection as a constrained allocation problem. The main contribution is to show that embedding capacity can be allocated across heterogeneous categorical predictors according to an explicit approximation-estimation tradeoff. We characterize approximation error through the singular-value tail of the latent category representation, while estimation error…