upvote
They want to ask the iOS Foundation model (frontier on device intelligence for something small) for instance about emergency procedures and life-saving info. I wouldn’t trust that model with much at all though. More likely to find what you need from miniature survival guides.
reply
> They want to ask the iOS Foundation model (frontier on device intelligence for something small)

This is a bit of a straw man, TBH.

For one thing, "LLM-in-a-box" doesn't necesssarily imply a device as small as a phone.

For another, you'd need to convince people that the iOS Foundation model is the "frontier" of LLMs that run on phones when it is really not. AFAIK it is noticeably outperformed by the Gemma 4 E2B model and certainly the E4B.

https://blog.google/innovation-and-ai/technology/developers-...

Here is a common-or-garden youtube video that includes a demonstration of how much better the E2B is:

https://www.youtube.com/watch?v=sTxyBUbdZcA

Whether this idea (LLMs for emergency/survival scenarios) has value, I don't know, so I am not offering an opinion, but you should approach it with a good faith argument.

I am an LLM cynic but I suppose if I was to be without connectivity but with power for a while, a device with the Gemma 4 E2B or E4B model on it might be helpful or interesting to have. If such a device had the 12B QAT model on it, that really would cross the line to utility. Not sure it has value in the OP's scenario, still.

reply
I meant the new 20B param Foundation models, not the ones from last year. But sure Gemma might be better
reply