{"id":"arxiv/2607.29674","url":"https://arxiv.org/abs/2607.29674","tags":["math.OC","cs.LG"],"score":0,"title":"Sign compression for Muon: SignMuon, MuonSign, and the Limits of Error Feedback","domain":"math.OC","source":"arxiv","authors":["Maria Smirnova","Alexey Kravatskiy"],"reviews":0,"subject":"math.OC","summary":"SignMuon compresses the Muon update to one bit per parameter by taking its elementwise sign, providing the most direct way to run a matrix-aware optimizer under an extremely low communication budget. It outperforms SignSGD in practice, yet it can ascend even on a linear function. Signing the gradient before the Linear Minimization Oracle (LMO), rather than after, does not repair this: we construct a small explicit instance on which sign-before (MuonUSign) and sign-on-both-sides (MuonSign) ascend as well, so no placement of the sign around the oracle descends in general. Error feedback, the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-07-31","reactions":{}}