Efficient variance reduction for randomized Kaczmarz methods via residual-tracking control variates
The randomized Kaczmarz (RK) method is a widely used and effective class of iterative algorithms for solving large-scale linear systems. For inconsistent systems, however, the persistent variance caused by randomization prevents the method from converging exactly to the least-squares solution. In this paper, we introduce a residual-tracking control variate framework for reducing this variance while retaining the row-action structure and low per-iteration cost of RK. The resulting variance-reduced RK method uses constant step sizes, accesses only sampled rows of the coefficient matrix, and…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2610.39537
curl -X POST /api/v1/records/arxiv/2610.39537/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.39537/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'