upvote
Apple’s Photos ecosystem is privacy oriented and as a result some (now) baseline features require the use of local models.

The Foundation models keep a surprisingly decent set of data available for fast filtering by a local LLM.

I’ve found a slower, second pass, is needed by Qwen to clean it up. (I am running on the new Mac Mini m5 pro 64gb.)

I’ve run my own tests using a date range, a short description of a red cedar planter box build I did last year, and a set of known correct photos.

There is some cool stuff you can do without sending your family’s pics up to any of the frontier model providers.

reply
I've found some strange guardrails with the Foundation models. Like blocking describing of any photo with a single woman in it. It does this relatively consistently but with a different subset every time. Like out of 10 photos in the set, it's skips 6 then the next run, it skips 3. Have you seen guardrail issues like this?

I switched to Gemma 4 instead.

reply
same i am using new embeddinggemma. seems far more capable than foundation models.
reply
I am going to assume that means "a women by herself" and not that it can magically detect her marital status before refusing to continue (I suppose it could be laser-focused on wedding rings...)
reply
No. Apple’s Photos ecosystem uploads all Photos effectively unencrypted to Apple in a way that is readable by Apple, allowing Apple to do server-side analysis of all content. This content is also provided to US or Chinese federal authorities without due process or warrants.

Nothing about iCloud Photos is private.

reply
With Advanced Data Protection enabled (it's not available globally but it is in the US), Photos is E2EE.
reply
I don't want any of these features and yet they've been forced upon me and are now getting in the way of me actually using my computer how I want. Games and heavy applications slow down and stutter because of "AI" background processes, even with App Tamer, my machine runs too hot to even touch when just idling. Compared to when I got my M2 in '23 and thought, "This is the fastest and snappiest machine I've ever used", my experience with an M5 and the latest macOS version is nothing short of an anti-consumer hellscape.
reply
My Macs run cool and silently. I've never observed a background "AI" process consuming resources.
reply
It's not just AI processes. But things like mediaanalysisd, duetexpertd, etc. even the freaking menu bar agent, all regularly pound my computer both when idling and when in use.

I recently installed App Tamer which is helping a bit, but it doesn't allow me to tame everything. I just checked now and duetexpertd was trying to use nearly two full cores. I have all iCloud integrations turned off, I do not use iCloud at all, and I do not have an iPhone, so I am flabbergasted that this iCloud desktop-phone syncing process runs at such high core usage in the background with extreme regularity. Proof: https://imgur.com/VkBh9bi

Unfortunately, this does nothing for services such as WindowServer which now often takes up 50-100% of a core just on its own.

I have reinstalled and upgraded to the latest version. This MacBook is only a few months old.

While typing this message and literally just having open Codex with one running task that is not doing anything substantial, and Firefox, with no high CPU usage from any tab, my laptop got so hot that I had to use another installed program, Stats, to manually bump up the fan since macOS also has absolutely garbage native system fan controls.

I have fibromyalgia and seem to be sensitive to hot keys; my Thinkpad regularly getting to hot to touch with even light usage is EXACTLY why I went and bought a MacBook one morning in '23. One morning I touched my keyboard and realized I was tired of singeing the nerves on my fingertips and having them hurt for hours. So now in '26, finding myself in the same exact position but with a much more expensive computer, I feel like I am living in a corporate hellscape nightmare.

One thing I have noticed is all of my cores can sit idle except a single one and that will still heat up the machine a lot. If the hardware is designed as such, the software MUST be designed to work around this and not blast a core for 10 minutes straight every time one of a dozen or two misbehaving system processes wants to complete a background task. If the software is not designed for this, the hardware is incomplete and faulty. This would be true if it was shipped as firmware; software doesn't get a free pass here.

But now Pages and Numbers recommend document titles for me, so.... worth it?

reply
this is not my experience at all. I wonder if one of your tweaks is causing the software to get into a bad state. Likely worth reporting to Apple even if it feels like it's going into a void.
reply
[delayed]
reply
Interesting, this has not been my experience at all. I have an M5 machine and I'm not even aware of what AI features have been added, and it's streets ahead of my old M1 Pro in speed.
reply
The M1 used to be adequate in speed. Then Apple kept adding always-on cloud daemons that run even if you don’t use iCloud.
reply
peep the comment I just made to the adjacent commenter, that has been my experience. I basically have to run my fans at full speed all day while working now in order to type on my computer (when I'm not using my magic keyboard). It is like a huge problem, not even just a small one but like something that is affecting me negatively every single day, increasingly making me want to break this machine in half and disappear into the woods.
reply
Exactly my thought as I read it.

They make and sell the hardware that will actually make AI something everyone can used without needing to rely on OpenAI/Anthropic et al.

Apple has never had a moat, anyone else could have built this sort of hardware but they haven't.

So they don't care which model wins, because it will always move out to the edge of the network, and they own a large chunk of that edge.

reply
Well, the moat is that cpu/npu development is very hard, requires talented engineers, and requires access to cutting edge fab process, all of which in turn costs a lot of $$$. So, sure, “anyone” who has all that can definitely breach Apple’s moat.
reply
Ok.. and why specifically do people work at Apple?

Hint: money is not the only reason.

Jeez.

reply
Most of the smart people I know have left Apple because over the last ten or fifteen years, all of the reasons other than money have gone away, and they don’t pay well.
reply
> Apple has never had a moat, anyone else could have built this sort of hardware but they haven't.

I think both points are very incorrect. Apple has a massive moat. And Apple is making hardware (specifically, CPUs) that are two years ahead.

reply
Ermmm what?

Apples largest competitive advantage has always been and always will be - trust combined with epic marketing to make the vast majority of people aware of it.

Trust of quality, privacy w.r.t data etc.

I’m sorry but I’ve seen so many bad takes re. Apple over the years. Many of you think you are so smart on topics outside of your domain - but you’re not.

reply
Don’t underestimate how much of their success is due to unusual internal advantages over competitors.

They spent decades learning to eliminate a 1000 headaches for themselves, and many for their customers, by accumulating vertical integration:

The co-design of their own comms, processors, devices and OS variants. Their own integrated supply chain and sales channels.

The better the results, the more invisible or clock-like their delivery.

Very easy to overlook. But nobody can match them on their terms.

(Nintendo also applied a unique set of internal advantages to generations of successful devices: vertically integrating humble components, highly scoped software, a strong theory of fun, and deep branding with novel polished interfaces.)

reply
What exactly about the parent comment is wrong? Apple has always been good at making hardware that people are willing to pay a premium to use. I can easily imagine them playing a similar role in local LLMs to the role they played in personal computing in the 1980s or smartphones in the 2010s.
reply
> Apples largest competitive advantage has always been and always will be - trust.

Lmao

> Many of you think you are so smart on topics outside of your domain

Turn the mirror around

reply
Nvidia is also selling the shovle but they train their own LLM and by doing so they can fine tune their CUDA/Chip to have a better shovel than others.

Nvidia's own model does not have to beat OpenAI or any SOTA model. Nvidia just need to build up the in house expert and knowledge to make a better chip since hyperscalers and none hyperscaler like Meta is building their own AI chip now.

Apple can chose not to train their own model to learn how to sell a better shovel.

reply
> They are out here selling the shovels

just wish their containerization / linux compat wasn't so nerfed. Just moved my homelab's inference engine over to a GB10 from a Mac MTP setup to have first class k8s support, as well as open up access to the broader CUDA ecosystem (cuOpt etc.).

reply
That's just BS cope. They tried and miserably failed - and still are failing badly. Remember, they were the ones to push for AI with "Siri". Many firings later and 2 CEOs later we are still exactly in square one. The fucking thing can't even get who I want to call, let alone set an alarm without touching my phone FFS.
reply
apple is pretty well set up for this because they do all their hardware in house. if they wanted to, they could pivot in this direction. Ternus is also a hardware guy.
reply