Id: arxiv/2607.27721 Url: https://arxiv.org/abs/2607.27721 Tags: math.PR, math.ST Score: 0 Title: Asymptotic bias of the plug-in Shannon entropy estimator under a regularly varying occupancy model Domain: math.PR Source: arxiv Authors: Takato Hashino, Koji Tsukuda Reviews: 0 Subject: math.PR Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-30 Page: https://delphi.science/r/arxiv/2607.27721 Estimating the Shannon entropy of discrete distributions with countably infinite support is a challenging problem. In this paper, we investigate the bias of the plug-in estimator $\hat{H}_n$ for the Shannon entropy $H(\boldsymbol{p})$ under an occupancy model whose frequency sequence exhibits regular variation with tail index $α\in(0,1)$. Using Poissonization and the theory of regular variation, we establish the asymptotic relation $|\mathsf{E}[\hat H_n] - H(\boldsymbol{p})| \sim n^{α-1}L(n)C_α$, where $L$ is a slowly varying function and $C_α$ is an explicit constant depending only on $α$…