Evaluating 35 open-weight models across three context lengths (32K, 128K, 200K), four temperatures, and three hardware platforms—consuming 172 billion tokens across more than 4,000 runs—we find that the answer is “substantially, and unavoidably.” Even under optimal conditions—best model, best temperature, temperature chosen specifically to minimize fabrication—the floor is non-zero and rises steeply with context length. At 32K, the best model (GLM 4.5) fabricates 1.19% of answers, top-tier models fabricate 5–7%, and the median model fabricates roughly 25%.


No, it’s real ™. I’m running on a Quadro P1000 with 4GB vram (or a Tesla P4 with 8GB). My entire raison d’être is making potato tier computing a thing.
https://openwebui.com/posts/vodka_when_life_gives_you_a_potato_pc_squeeze_7194c33b
Like a certain famous space Lothario, I too do not believe in no win scenarios.