Reasoning level influences both of those things dramatically. So we need to have it available as a parameter for comparisons.
replynot a metric, it's a parameter used at inference time
replyYes, but what metric defines what constitutes a given reasoning level? That's what's arbitrary here, not the label (which is also arbitrary).
reply