{"id":"arxiv/2610.11315","url":"https://arxiv.org/abs/2610.11315","tags":["cs.LG","cs.CV","math.OC"],"score":0,"title":"Deflating the Hessian: Rank-4 W4A4 Quantization for Multimodal Diffusion Transformers","domain":"cs.LG","source":"arxiv","authors":["Shiwen Wang","Pengxiang Zhao","Xiaoming Yuan"],"reviews":0,"subject":"cs.LG","summary":"In diffusion transformers, low-rank branches can mitigate 4-bit weight--activation (W4A4) post-training quantization (PTQ) loss by decomposing each weight into a low-bit residual and a high-precision low-rank component. Existing low-rank PTQ approaches, however, either optimize low-rank compensation and residual quantization separately, often requiring higher ranks, or rely on second-order weight updates without explicitly modeling activation quantization error, which becomes particularly pronounced under 4-bit quantization. To address these limitations, we present HSVDQuant, a unified…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-08","reactions":{}}