upvote
Nor do they have to. Inference from different users is batched together.
reply
Ok? Even if they're batched? Grid energy is batched too
reply