> Chat completions is just a network call like anything else

But what if Chat completion was resolved locally with hardware? Or what if I want my OS to coordinate Chat completions locally and, if my hardware is overwhelmed, send some to network?

You do have a valid point, yes, that what I am saying, without support for local hardware could be done with a sort of Open Router equivalent.

> they don’t need to pay separately (they can use the same account), they just pass their API key over the network to the completions server

That I would be conformable putting what I am saying on my parents phone. I do no trust my parents to manage API keys. What I am saying is an ecosystem thing, not only a low level thing