Dangerous Liaisons of Convex Learning and Non-Affine Aggregation

Thomas Boudou, Batiste Le Bars, Nirupam Gupta, Aurélien Bellet

arXivarxiv/2606.28123Jun 26, 2026cs.LGscore 0

Last-iterate convergence and generalization guarantees in first-order convex learning hinge on the monotonicity of the update operator. While linear averaging preserves the monotonicity of gradient updates, this property is often violated when gradients are aggregated non-affinely, as in modern pipelines enforcing constraints like adaptivity, privacy, robustness or fairness. Whether it is possible to design non-affine aggregation rules that maintain monotonicity has remained an open question. We answer this question negatively: we prove that the monotonicity of aggregated gradients is…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2606.28123
curl -X POST /api/v1/records/arxiv/2606.28123/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2606.28123/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'