With benchmarks, you can re-run them after a change. A measurement in a paper will go out of date quickly unless turned into a benchmark.