They made an extremely strong claim:

> None of this would matter if it changed the model's answers

If they want to assert that the answers don’t change, then perhaps they should calculate the statistical distance between the token probability outputs or something to that effect. I doubt the results would indicate that the answers don’t change by any reasonable interpretation.

Maybe the results are still good enough.

vLLM's study also concluded that "FP8 can deliver meaningful latency and capacity gains with small or negligible accuracy loss". Their benchmarks include LiveCodeBench 6.

https://vllm-project.github.io/2026/04/22/fp8-kvcache.html