{"id":"arxiv/2605.00473","url":"https://arxiv.org/abs/2605.00473","tags":["cs.LG","math.OC"],"score":0,"title":"Near-optimal and Efficient First-Order Algorithm for Multi-Task Learning with Shared Linear Representation","domain":"cs.LG","source":"arxiv","authors":["Shihong Ding","Fangyu Du","Cong Fang"],"reviews":0,"subject":"cs.LG","summary":"Multi-task learning (MTL) has emerged as a pivotal paradigm in machine learning by leveraging shared structures across multiple related tasks. Despite its empirical success, the development of likelihood-based efficiently solvable algorithms--even for shared linear representations--remains largely underdeveloped, primarily due to the non-convex structure intrinsic to matrix factorization. This paper introduces a first-order algorithm that jointly learns a shared representation and task-specific parameters, with guaranteed efficiency. Notably, it converges in $\\widetilde{\\mathcal{O}}(1)$…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-01","reactions":{}}