{"id":"arxiv/2610.12544","url":"https://arxiv.org/abs/2610.12544","tags":["cs.LG","cs.IT","math.ST","stat.ML"],"score":0,"title":"Transformer-Based Masked Diffusion Models Provably Learn Distributions with Latent Structure","domain":"cs.LG","source":"arxiv","authors":["Jingda Wu","Changxiao Cai"],"reviews":0,"subject":"cs.LG","summary":"Masked diffusion models (MDMs) generate discrete data by iteratively unmasking multiple tokens in parallel using a learned mask predictor. Their output carries two errors: parallelization error due to parallel sampling, and estimation error from the mask predictor learned with finite samples. Existing theory treats these errors separately, and the available statistical bounds typically scale with the number $V^L$ of length-$L$ sequences over a vocabulary of size $V$, suffering from the curse of dimensionality. In this work, we establish end-to-end statistical guarantees showing that…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-08","reactions":{}}