Subspace Optimization for Efficient Federated Learning under Heterogeneous Data

Shuchen Zhu; Zhengyang Huang; Yuqi Xu; Peijin Li

Subspace Optimization for Efficient Federated Learning under Heterogeneous Data

Shuchen Zhu, Zhengyang Huang, Yuqi Xu, Peijin Li

arXivarxiv/2604.25467Apr 28, 2026cs.LGscore 0

Federated learning increasingly operates in a large-model regime where communication, memory, and computation are all scarce. Typically, non-IID client data induce drift that degrades the stability and performance of local training. Existing remedies such as SCAFFOLD introduce heterogeneity-correction mechanisms to address this challenge, but they incur substantial extra communication and memory overhead. This paper proposes a subspace optimization method for federated learning (SSF), which performs heterogeneity-corrected optimization in a low-dimensional subspace using only projected…

Source JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2604.25467
curl -X POST /api/v1/records/arxiv/2604.25467/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2604.25467/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'