SCAFFOLD under Hessian Similarity: Sharp Convergence Rates

Zhirayr Tovmasyan; Slavomír Hanzely; Egor Shulgin; Peter Richtárik; Sebastian U. Stich

SCAFFOLD under Hessian Similarity: Sharp Convergence Rates

Zhirayr Tovmasyan, Slavomír Hanzely, Egor Shulgin, Peter Richtárik, Sebastian U. Stich

arXivarxiv/2610.35663Oct 26, 2026cs.LGscore 0

One of the main challenges of federated learning is heterogeneous data split among the clients, leading to biased local updates called client drift. The SCAFFOLD algorithm (Karimireddy et al., 2020) corrects client drift with control variates, but its relation to the similarity of client data is not yet fully understood: the original similarity-based guarantees cover only quadratics with a stronger second-order similarity assumption, and a follow-up weakly convex analysis (Luo et al., 2025) obtains a $\sqrt{Lδ}$ dependence for $L$-smooth losses with averaged Hessian similarity $δ$. We…

Source JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2610.35663
curl -X POST /api/v1/records/arxiv/2610.35663/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.35663/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'