{"id":"arxiv/2602.08347","url":"https://arxiv.org/abs/2602.08347","tags":["stat.ME","math.ST"],"score":0,"title":"Estimating the Shannon Entropy Using the Pitman--Yor Process","domain":"stat.ME","source":"arxiv","authors":["Takato Hashino","Koji Tsukuda"],"reviews":0,"subject":"stat.ME","summary":"The Shannon entropy is a fundamental measure for quantifying diversity and model complexity in fields such as information theory, ecology, and genetics. However, many existing studies assume that the number of species is known, an assumption that is often unrealistic in practice. In recent years, efforts have been made to relax this restriction. Motivated by these developments, this study proposes an entropy estimation method based on the Pitman--Yor process, a representative approach in Bayesian nonparametrics. By approximating the true distribution as an infinite-dimensional process, the…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-02-09","reactions":{}}