upvote
Until hiding PII from the cloud LLM is a resolved issue, running local LLMs will remain a necessity.

There are workplaces that refuse to use LLMs because they fear the devs will expose sensitive data without care.

reply
> will cost an insane amount as well

We will get to a point where prosumer laptops that etch SoTA LLMs in removable silicon will be as expensive as cars.

reply