{"id":"arxiv/2610.35663","url":"https://arxiv.org/abs/2610.35663","tags":["cs.LG","math.OC"],"score":0,"title":"SCAFFOLD under Hessian Similarity: Sharp Convergence Rates","domain":"cs.LG","source":"arxiv","authors":["Zhirayr Tovmasyan","Slavomír Hanzely","Egor Shulgin","Peter Richtárik","Sebastian U. Stich"],"reviews":0,"subject":"cs.LG","summary":"One of the main challenges of federated learning is heterogeneous data split among the clients, leading to biased local updates called client drift. The SCAFFOLD algorithm (Karimireddy et al., 2020) corrects client drift with control variates, but its relation to the similarity of client data is not yet fully understood: the original similarity-based guarantees cover only quadratics with a stronger second-order similarity assumption, and a follow-up weakly convex analysis (Luo et al., 2025) obtains a $\\sqrt{Lδ}$ dependence for $L$-smooth losses with averaged Hessian similarity $δ$. We…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-26","reactions":{}}