{"id":"arxiv/2608.22145","url":"https://arxiv.org/abs/2608.22145","tags":["cs.LG","math.NA"],"score":0,"title":"Loss Landscape Features That Make Adam Stall: Definitions, Estimators, and the Preconditioned Hessian View","domain":"cs.LG","source":"arxiv","authors":["Rodion Podorozhny"],"reviews":0,"subject":"cs.LG","summary":"Across implicit-neural-representation (INR) architectures and analytic benchmarks we observe that a thoroughly tuned Adam (especially its learning rate (lr), e.g. in a hyperparameter sweep from $lr = 0.05$ to $10^{-8}$) can potentially reach a very low loss even on ill-conditioned loss landscape or converge at a plateau far above the loss attained by second-order methods. This report defines the measured metrics that help determine if Adam can mitigate the ill-conditioning on a given loss landscape. We provide the indicators by which each outcome is determined, that are: the condition number…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-23","reactions":{}}