Don't get me wrong; in the long term I see the price of local inference falling as their chips continue to get 15-20% faster every year, and meanwhile the "intelligence per billion parameter" chart is rising. There will be a magic point where they cross, and "good enough" reaches your phone. That's when Apple starts to drink Nvidia's milkshake.
replyApple and NVIDIA prices are not going to fall.
replyTheir competitors will. Anyone locked into these two ecosystems are willingly going along with it.
It’s not about the price of Apple products falling—I was commenting that the price of inference will continue to fall (chips getting faster). If “good enough” inference is in your pocket, this benefits Apple and harms Nvidia.
replyI got your insight as you intended, and I agree that good enough models able to run on commodity hardware will hurt Nvidia.
replyWe aren't far from that point.