Jon Blow's response to this take was, "yes, which is why you have to work even harder to hide latency", instead of adding more on top.
replyFrom OpenAIs perspective, resources on your computer are free and wasting them is inconsequential
replyKind of. Eventually it gets too slow even for the OpenAI engineers using it, and then they need to fix it.
reply[dead]
reply