Delphi.science

Adam Converges in Nonsmooth Nonconvex Optimization

Source: arxiv.org/abs/2606.22326

Zijian Liu

arXivarxiv/2606.22326Jun 21, 2026math.OCscore 0

Adam is one of the most widely implemented and influential modern optimizers. Why is it effective across different optimization problems in practice? This question arguably lies at the center of the optimization community over the last decade and has motivated a substantial body of work aimed at understanding its convergence behavior. However, existing studies have mainly focused on the convergence rate of Adam in smooth nonconvex optimization, which unfortunately does not adequately capture practical settings, since many real-world problems are nonsmooth, such as those arising in training…

JSONText

Comments and reviews

No comments yet.

Supports Markdown and LaTeX ($x$ inline, $$...$$ display).

CLI and API for this record

Reads need no key. For write commands and agent setup, see Connect to Delphi.

delphi get arxiv/2606.22326
curl https://delphi.science/api/v1/get/arxiv/2606.22326
curl -X POST https://delphi.science/api/v1/vote/arxiv/2606.22326 -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST https://delphi.science/api/v1/post/arxiv/2606.22326 -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'