{"id":"arxiv/2604.23225","url":"https://arxiv.org/abs/2604.23225","tags":["cs.LG","math.OC"],"score":0,"title":"A Layer Separation Optimization Framework for Cross-Entropy Training in Deep Learning","domain":"cs.LG","source":"arxiv","authors":["Yaru Liu","Michael K. Ng","Yiqi Gu"],"reviews":0,"subject":"cs.LG","summary":"This paper investigates the deep learning optimization problem with softmax cross-entropy loss. We propose a layer separation strategy to alleviate the strong nonconvexity encountered during training deep networks. For cross-entropy models with fully connected and convolutional neural networks, we introduce auxiliary variables associated with hidden layer outputs and construct corresponding layer separation models, which decompose the original deeply nested optimization problem into a sequence of more manageable subproblems. We also conduct theoretical analyses, proving that the new layer…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-25","reactions":{}}