Intrinsic Gradient Barriers in Pushforward Deep Generative Models

Edric Tam, Qingyang Liu, Barbara Engelhardt, Ray Bai

arXivarxiv/2610.34484Oct 25, 2026stat.MLscore 0

Broad classes of deep generative models (DGMs) operate by learning to map a simple source distribution, such as a standard Gaussian, to a complex high-dimensional target distribution. Despite their success, DGMs often empirically struggle to accurately represent distributions with heavy tails or well-separated modes. In this work, we show that these difficulties reflect intrinsic properties of the underlying transport problem rather than particular neural network architectures or training procedures. We establish quantitative lower bounds on the gradients and Jacobians of pushforward…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2610.34484
curl -X POST /api/v1/records/arxiv/2610.34484/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.34484/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'