{"id":"arxiv/2609.12599","url":"https://arxiv.org/abs/2609.12599","tags":["cs.LG","cs.AI","math.OC"],"score":0,"title":"SIMS: Scale-Invariant Merit-Function-Based Scalarization for Multi-Task Learning","domain":"cs.LG","source":"arxiv","authors":["Zebin Chen","Fei Xing","Yang Chen","Hua Liu","Andy HF Chow","Yuhua Qian","Yu Zhang"],"reviews":0,"subject":"cs.LG","summary":"Multi-task learning (MTL) requires navigating unavoidable trade-offs among competing objectives. This paradigm is frequently formulated as multi-objective optimization (MOO), where the scalarization is favored to reduce an MOO problem to a single objective. We empirically find that existing merit-function-based scalarization approaches are sensitive to the relative scales of different objectives in practical MTL, where task losses commonly differ by orders of magnitude. The optimization process often favors objectives with larger scales even though the underlying Pareto optimal solutions…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-11","reactions":{}}