upvote
Yeah that makes sense. I'm more familiar with seeing tok/s/user + TTFT rather than the total node throughput.
reply