{"id":"arxiv/2601.21623","url":"https://arxiv.org/abs/2601.21623","tags":["cs.LG","math.NA"],"score":0,"title":"LAMP: Look-Ahead Mixed-Precision Inference of Large Language Models","domain":"cs.LG","source":"arxiv","authors":["Stanislav Budzinskiy","Marian Gloser","Tolunay Yilmaz","Ying Hong Tham","Yuanyi Lin","Wenyi Fang","Fan Wu","Philipp Petersen"],"reviews":0,"subject":"cs.LG","summary":"Mixed-precision computations are a hallmark of the current stage of AI, driving the progress in large language models towards efficient, locally deployable solutions. This article addresses the floating-point computation of compositionally-rich functions, concentrating on transformer inference. Based on the rounding error analysis of a composition $f(g(\\mathrm{x}))$, we provide an adaptive strategy that selects a small subset of components of $g(\\mathrm{x})$ to be computed more accurately while all other computations can be carried out with lower accuracy. We then explain how this strategy…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-01-29","reactions":{}}