upvote
I am absolutely open to being corrected but I can't think of a single current era FOSS project that apple is optimizing and shipping with their computers.
reply
The local ai is used by Apple services, mostly. Though there is a Swift SDK to access it, apparently.
reply
You can run Ollama and it’s kind with MLX models for speed.

Tend to be better than Apple AI.

reply
The product marketing managers write for the target audience; of course they know lots of people buying these are the local LLM crowd.

I actually wouldn't want a serious model shipping 'on disk'. Models release so often, it's going to get outdated quickly. LMStudio is trivial to set up.

reply
Now imagine a model shipped in silicon that gives 5,000 tokens per second at Opus 4.8 quality
reply