{"id":"arxiv/2610.21340","url":"https://arxiv.org/abs/2610.21340","tags":["stat.ML","cs.LG","math.ST"],"score":0,"title":"Dimension-Free PAC-Bayes Generalization for Deep Neural Networks via Dirichlet Processes","domain":"stat.ML","source":"arxiv","authors":["Sumit Vashishtha"],"reviews":0,"subject":"stat.ML","summary":"Classical PAC-Bayesian generalization theory places prior distributions over Euclidean parameter space $Θ\\subseteq \\mathbb{R}^D$, causing relative entropy to scale with network dimension $D$. For modern overparameterized neural networks where $D \\gg n$, this parameter-counting dependency yields vacuous generalization bounds ($> 1{,}000\\%$). In this work, we resolve this barrier by shifting prior specification from internal parameters to the non-parametric space of data distributions $\\mathcal{M}_1(\\mathcal{Z})$ via a \\textbf{Dirichlet Process (DP)}, $\\mathcal{DP}(α, F_0)$, inducing parameter…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-10-15","reactions":{}}