{"id":"arxiv/2607.25091","url":"https://arxiv.org/abs/2607.25091","tags":["cs.AI","cs.CL","cs.LG","math.OC","stat.CO"],"score":0,"title":"Towards Robust Reinforcement Learning for Small-Scale Language Model Agents","domain":"cs.AI","source":"arxiv","authors":["Md Rezwanul Haque","Md. Milon Islam","Fakhri Karray"],"reviews":0,"subject":"cs.AI","summary":"The alignment of Small Language Models (SLMs) in the 70--500M parameter range using reinforcement learning is often considered unstable, though the underlying failure mechanisms have not been systematically investigated. In the State-of-the-Art (SOTA) research, fifteen (model, corpus) configurations were trained using Proximal Policy Optimization (PPO). The experiments included Pythia-70M, 160M, 410M and SmolLM2-135M, 360M on the TinyStories, CNN/DailyMail, and Wikitext-103 corpora. Three reproducible failure modes were identified in small-scale language models: silent LoRA parameter…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-27","reactions":{}}