Id: arxiv/2603.06759 Url: https://arxiv.org/abs/2603.06759 Tags: math.ST Score: 0 Title: A New Estimator of Kullback--Leibler Divergence via Shannon Entropy Domain: math.ST Source: arxiv Authors: Mehmet Siddik Cadirci, Martin Singull Reviews: 0 Subject: math.ST Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-03-06 Page: https://delphi.science/r/arxiv/2603.06759 We examine the estimation of the Kullback-Leibler (KL) divergence and the use of the goodness-of-fit test for multivariate continuous distributions. Our starting point is the maximum entropy principle for Shannon entropy: among all distributions with a fixed mean vector and covariance matrix, the multivariate Gaussian distributions uniquely maximize entropy. As a result, the KL divergence from a moment-matched Gaussian distribution to an unknown density can then be written as the \emph{entropy difference}, which is a suitable information-theoretic measure of divergence from the Gaussian…