{"id":"arxiv/2606.30455","url":"https://arxiv.org/abs/2606.30455","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Curvature-Weighted Gradient Diversity: A Noise Measure for Geometry-Adaptive SGD Schedules","domain":"cs.LG","source":"arxiv","authors":["Muhammad Hamza","Ayush Goel"],"reviews":0,"subject":"cs.LG","summary":"The standard convergence analysis of mini-batch stochastic gradient descent (SGD) models gradient noise using a single variance term that treats all parameter directions equally, ignoring the fact that noise in high-curvature directions has less impact because learning rates are already constrained there. We introduce Curvature-Weighted Gradient Diversity (CWGD), a geometry-aware measure that weights per-sample gradient diversity by the inverse square root of the Hessian, providing a tighter proxy for the effective optimization noise. For strongly convex quadratic objectives with diagonal…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-29","reactions":{}}