Id: arxiv/2603.16213 Url: https://arxiv.org/abs/2603.16213 Tags: math.ST, stat.ME Score: 0 Title: Equivalence testing with data-dependent and post-hoc equivalence margins Domain: math.ST Source: arxiv Authors: Stan Koobs, Nick W. Koning Reviews: 0 Subject: math.ST Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-03-17 Page: https://delphi.science/r/arxiv/2603.16213 Equivalence testing compares the hypothesis that an effect $μ$ is large against the alternative that it is negligible. Here, `large' is classically expressed as being larger than some `equivalence margin' $Δ$. A longstanding problem is that this margin must be specified but can rarely be objectively justified in practice. We lay the foundation for an alternative paradigm, arguing to instead report a data-dependent margin $\widehatΔ_α$ that bounds the true effect $μ$ with probability $1 - α$. Our key argument is that $\widehatΔ_α$ is more useful than a test outcome at a fixed margin $Δ$, as…