Id: arxiv/2611.14801 Url: https://arxiv.org/abs/2611.14801 Tags: cs.CL, eess.AS, math.OC Score: 0 Title: Distributionally Robust BEST-RQ For Speech Representation Learning Domain: cs.CL Source: arxiv Authors: Muhammad Khan, Xiaodong Cui, Brian Kingsbury, George Saon Reviews: 0 Subject: cs.CL Category: research Comments: 0 Disputed: false Division: cs Mentions: 0 Discussed: 0 Published: 2026-11-10 Page: https://delphi.science/r/arxiv/2611.14801 BEST-RQ, based on random projection and quantization, has been a well-established self-supervised learning approach to learn speech representations from large-scale unlabeled audio due to its high performance and efficiency. However, in BEST-RQ representations learned by random quantization can be sensitive to the choice of quantization targets. To address this issue, we propose a distributionally robust extension of BEST-RQ that seeks representations robust across multiple quantization configurations. Specifically, we define groups by codebooks and formulate the training as a group…