Proximal Adam algorithm for nonsmooth composite optimization and linear convergence under proximal PL geometry
Source: arxiv.org/abs/2611.17727
We analyze Adam-type methods for nonsmooth composite optimization problems $\min_xΦ(x)=f(x)+h(x)$, where $f$ is smooth and $h$ is convex, proper, and lower semicontinuous. The nonsmooth term is treated by a metric-weighted proximal map, while the smooth term is preconditioned by the Adam second-moment matrix. We prove a composite descent lemma whose constants depend explicitly on the spectral bounds of the adaptive metric and a residual--step equivalence that converts proximal step decay into subgradient stationarity. These yield an $O(1/N)$ bound on the minimum proximal stationarity…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2611.17727
curl -X POST /api/v1/records/arxiv/2611.17727/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2611.17727/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'