{"id":"arxiv/2603.26048","url":"https://arxiv.org/abs/2603.26048","tags":["stat.ML","cs.LG","math.ST"],"score":0,"title":"Asymptotic Optimism for Tensor Regression Models with Applications to Neural Network Compression","domain":"stat.ML","source":"arxiv","authors":["Haoming Shi","Eric C. Chi","Hengrui Luo"],"reviews":0,"subject":"stat.ML","summary":"We study rank selection for low-rank tensor regression under random covariates design. Under a Gaussian random-design model and some mild conditions, we derive population expressions for the expected training-testing discrepancy (optimism) for both CP and Tucker decomposition. We further demonstrate that the optimism is minimized at the true tensor rank for both CP and Tucker regression. This yields a prediction-oriented rank-selection rule that aligns with cross-validation and extends naturally to tensor-model averaging. We also discuss conditions under which under- or over-ranked models…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-03-27","reactions":{}}