{"id":"arxiv/2609.27930","url":"https://arxiv.org/abs/2609.27930","tags":["stat.ME","cs.LG","math.ST","stat.ML"],"score":0,"title":"Dirichlet Process Mixtures of Trees with Gaussian Process Splits: A Bayesian Nonparametric Framework with Posterior Contraction Rate","domain":"stat.ME","source":"arxiv","authors":["Subhasish Basak","Anik Roy","Sourabh Bhattacharya"],"reviews":0,"subject":"stat.ME","summary":"We propose a Bayesian nonparametric mixture of regression trees with a Dirichlet process prior over tree-parameter pairs, enabling data-driven selection of ensemble size and unifying CART, BART, random forests, and boosting. A novel splitting rule driven by the posterior predictive of a Gaussian process within each terminal node generates flexible, smooth decision boundaries; remarkably, the GP density cancels exactly in the Metropolis--Hastings ratio for GROW/PRUNE moves, ensuring computational feasibility. An exact Gibbs sampler for posterior predictive inference propagates uncertainty…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-08-22","reactions":{}}