Optimizer as Detector: Stochastic Gradient Descent for Latent Mixture Models

Ye Shi, Xiao Jin, Chung-Piaw Teo

arXivarxiv/2609.07003Sep 7, 2026stat.MEscore 0

Pooling latent subpopulations can obscure relationships and yield misleading regression conclusions, including Simpson's paradox (SP). We propose a detector based on the steady-state dynamics of constant-step stochastic gradient descent (SGD). Unlike likelihood-based mixture tests and confounder-search methods, it requires neither a normal-mixture specification nor observed candidate confounders. Two linear pieces compete under a winner-take-all squared-error loss, and their normalized terminal separation forms the test statistic. Using diffusion approximations, we derive its asymptotic null…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2609.07003
curl -X POST /api/v1/records/arxiv/2609.07003/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2609.07003/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'