{"id":"arxiv/2606.22922","url":"https://arxiv.org/abs/2606.22922","tags":["cs.LG","cs.AI","math.AC","math.CO"],"score":0,"title":"Hierarchical Reinforcement Learning for Sparse-Reward Search in Commutative Algebra","domain":"cs.LG","source":"arxiv","authors":["Giorgi Butbaia","Paul Orland","Coco Huang","Davide Passaro","Lucas Fagan","Michele Tarquini","Hailong Dao","David Eisenbud","Ali Shehper","Sergei Gukov"],"reviews":0,"subject":"cs.LG","summary":"Applying machine learning techniques to solving long-standing mathematical conjectures can be particularly challenging due to their extreme reward sparsity. As an illustrative example, we consider Kalai's algebraic Hirsch conjecture and recast the construction of its counterexamples as a sparse-reward reinforcement learning problem on graphs. We propose a constrained options-based HRL framework with an equivariant graph neural network policy, which allows us to learn useful temporal abstractions for this task. We evaluate our approach over a wide range of degrees and demonstrate that it…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-22","reactions":{}}