{"id":"arxiv/2606.16028","url":"https://arxiv.org/abs/2606.16028","tags":["cs.LG","cs.IT","math.FA"],"score":0,"title":"The Information-Theoretic Benefit of Shared Representations under Orthogonality Constraints","domain":"cs.LG","source":"arxiv","authors":["Thomas Dittrich","Oliver Potocki","Philipp Grohs"],"reviews":0,"subject":"cs.LG","summary":"Modern deep learning architectures are increasingly multi-task and multi-modal, using a pretrained foundation model combined with task-specific, fine-tuned models. Empirically, exploiting similarity across different problems, instead of solving them individually, can significantly improve overall performance. While the generalization and sample complexity properties of multitask learning have been widely studied, the parametric complexity of joint approximation in comparison to separate approximation remains less well understood. The question is particularly relevant in modern deep learning,…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-14","reactions":{}}