Bounds on Spectral Gaps for Non-Reversible Markov Chains with Applications to Temporal Difference Learning
This work is motivated by the analysis of temporal difference algorithms, where stability can be guaranteed by bounding the eigenvalues of an associated matrix derived from a, typically non-reversible, Markov kernel. We generalize the existing sufficient conditions for stability and show that the associated eigenvalues can be bounded in terms of the Dirichlet spectral gap of the Markov kernel. We derive a collection of methods for showing that non-reversible Markov chains have positive spectral gaps. We show that if a Markov chain has positive absolute spectral gap, then it has a positive…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2606.07839
curl -X POST /api/v1/records/arxiv/2606.07839/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2606.07839/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'