Number go up, I guess? A lot of people derive great satisfaction from ever larger (or sometimes smaller) number. But, uh, 8X is probably too much, need to spread that out over a few generations.
replyThey obviously want to run AI models on their phone.
replyVery obviously you get a Mac Studio for that, not a phone. (Oh, the 96GB Studio is almost $6000, you counter? Imagine how much it would cost in a phone form factor).
replyYou can't possibly expect Apple to take that market segment seriously.
In theory it sounds alright, although in reality, the heat and power consumption make this less than ideal.
replyI am not sure single digit tk/s on weak model like ChatGPT OSS 20b @ Q3_K_M is going to be worthwhile.
Not to mention this has to be <0.01% of users who "want" to do this. The iPhone tooling would make it hard to even configure and spin up a local LLM.
> the most powerful consumer phone in the world today
replyAccording to what? (I don't disagree, just curious)