{"id":"arxiv/2607.14516","url":"https://arxiv.org/abs/2607.14516","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Adaptive Runge-Kutta Step Control Buys Training Loss, Not Generalization: An Honest Compute-Matched Study of RK-Adam Optimizers","domain":"cs.LG","source":"arxiv","authors":["Akhilesh Gogikar"],"reviews":0,"subject":"cs.LG","summary":"Interpreting optimizers as gradient-flow discretizations has motivated applying higher-order Runge-Kutta (RK) integrators to neural networks. We build a representative Adam variant (Bogacki-Shampine 3(2) RK pair, FSAL reuse, local-error step control) and evaluate it under a strict compute-matched protocol giving every method the same gradient-evaluation budget - an accounting this literature rarely enforces. Under it the RK variant loses to plain Adam on training loss in both minibatch and full-batch (RK's best-case) training. Instrumenting it shows the \"adaptivity\" is illusory: normalized…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-16","reactions":{}}