{"id":"arxiv/2601.11444","url":"https://arxiv.org/abs/2601.11444","tags":["cs.LG","cs.CV","math.ST","stat.ME","stat.ML"],"score":0,"title":"When Are Two Scores Better Than One? Investigating Ensembles of Diffusion Models","domain":"cs.LG","source":"arxiv","authors":["Raphaël Razafindralambo","Rémy Sun","Frédéric Precioso","Damien Garreau","Pierre-Alexandre Mattei"],"reviews":0,"subject":"cs.LG","summary":"Diffusion models now generate high-quality, diverse samples, with an increasing focus on more powerful models. Although ensembling is a well-known way to improve supervised models, its application to unconditional score-based diffusion models remains largely unexplored. In this work we investigate whether it provides tangible benefits for generative modelling. We find that while ensembling the scores generally improves the score-matching loss and model likelihood, it fails to consistently enhance perceptual quality metrics such as FID on image datasets. We confirm this observation across a…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-01-16","reactions":{}}