Parallelizing Large-Scale Tensor Network Contraction on Multiple GPUs

Feng Pan; Hanfeng Gu; Paul Springer; Xipeng Li

Parallelizing Large-Scale Tensor Network Contraction on Multiple GPUs

Feng Pan, Hanfeng Gu, Paul Springer, Xipeng Li

arXivarxiv/2606.01852Jun 1, 2026cs.DCscore 0

Exact tensor network contraction underpins quantum circuit simulation, quantum error correction, combinatorial optimization, and many-body dynamics. The dominant parallelization strategy, slicing, scales exponentially and incurs redundant computation. We present a multi-GPU framework that instead distributes intermediate tensors across devices with explicit communication, converting a fixed contraction path into a communication-efficient schedule via GEMM-oriented mode reordering and communication-aware mode distribution planning. Within a single DGX H100 node (8 GPUs, NVLink), distribution…

Source JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2606.01852
curl -X POST /api/v1/records/arxiv/2606.01852/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2606.01852/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'