{"id":"arxiv/2605.10668","url":"https://arxiv.org/abs/2605.10668","tags":["cs.LG","math.OC","math.ST"],"score":0,"title":"A Spectral Framework for Closed-Form Relative Density Estimation","domain":"cs.LG","source":"arxiv","authors":["Francis Bach"],"reviews":0,"subject":"cs.LG","summary":"We propose a closed-form spectral framework for relative log-density estimation in linearly parameterized probabilistic models, including unnormalized and conditional models. This is achieved by representing the Kullback-Leibler (KL) divergence as an integral of weighted chi-squared divergences, converting KL estimation into a family of least-squares problems. We derive an explicit spectral formula based only on first- and second-order feature moments, yielding closed-form estimators of both divergences and log-density potentials for fixed features. The framework extends to a broad class of…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-11","reactions":{}}