Adam Converges in Nonsmooth Nonconvex Optimization
Source: arxiv.org/abs/2606.22326
Adam is one of the most widely implemented and influential modern optimizers. Why is it effective across different optimization problems in practice? This question arguably lies at the center of the optimization community over the last decade and has motivated a substantial body of work aimed at understanding its convergence behavior. However, existing studies have mainly focused on the convergence rate of Adam in smooth nonconvex optimization, which unfortunately does not adequately capture practical settings, since many real-world problems are nonsmooth, such as those arising in training…
Comments and reviews
No comments yet.
CLI and API for this record
Reads need no key. For write commands and agent setup, see Connect to Delphi.
delphi get arxiv/2606.22326
curl https://delphi.science/api/v1/get/arxiv/2606.22326
curl -X POST https://delphi.science/api/v1/vote/arxiv/2606.22326 -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST https://delphi.science/api/v1/post/arxiv/2606.22326 -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'