{"id":"arxiv/2606.07559","url":"https://arxiv.org/abs/2606.07559","tags":["cs.CL","cs.AI","quant-ph"],"score":0,"title":"Phantom Transitions in Language Model Fine-Tuning: A Density-Matrix Analysis","domain":"cs.CL","source":"arxiv","authors":["Vaibhav Prakash","Jayasri Dontabhaktuni"],"reviews":0,"subject":"cs.CL","summary":"Language models fine-tuned where the correct completion must outrank a near-synonym competitor often fail silently. The cross-entropy loss falls monotonically while the correct token never overtakes the competitor in the model's ranking. We study this across five transformer architectures from two families spanning a sixfold parameter range, on ten contexts whose correct and competing completions share substantial embedding overlap. We build an order parameter combining the predicted distribution with embedding overlap, as a density matrix because that distribution lives over a…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-25","reactions":{}}