{"id":"arxiv/2609.11867","url":"https://arxiv.org/abs/2609.11867","tags":["cs.LG","math.OC"],"score":0,"title":"AdamX: Cosine similarity meets gradient descent","domain":"cs.LG","source":"arxiv","authors":["Francisco Caldas","Ruben Belo","Cláudia Soares"],"reviews":0,"subject":"cs.LG","summary":"We introduce AdamX, a first-order optimizer that incorporates cosine similarity as an adaptive mechanism for controlling update magnitudes. The proposed method is scalable, model-agnostic, and straightforward to integrate into existing training pipelines. We further introduce a variance rectification scheme that promotes smoother optimization during the early stages of training. Overall, we provide empirical evidence that AdamX achieves competitive convergence rates across a range of benchmark datasets and architectures. Performance is evaluated in terms of the number of epochs required to…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-10","reactions":{}}