{"id":"arxiv/2611.14801","url":"https://arxiv.org/abs/2611.14801","tags":["cs.CL","eess.AS","math.OC"],"score":0,"title":"Distributionally Robust BEST-RQ For Speech Representation Learning","domain":"cs.CL","source":"arxiv","authors":["Muhammad Khan","Xiaodong Cui","Brian Kingsbury","George Saon"],"reviews":0,"subject":"cs.CL","summary":"BEST-RQ, based on random projection and quantization, has been a well-established self-supervised learning approach to learn speech representations from large-scale unlabeled audio due to its high performance and efficiency. However, in BEST-RQ representations learned by random quantization can be sensitive to the choice of quantization targets. To address this issue, we propose a distributionally robust extension of BEST-RQ that seeks representations robust across multiple quantization configurations. Specifically, we define groups by codebooks and formulate the training as a group…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-10","reactions":{}}