upvote
Many API calls can be answered by something as underpowered as an Raspi. But AI needs very expensive GPUs to run.

So no way it will be as cheap. That is just wishfull thinking.

reply
Quite possibly. But, a thought I had some years back:

In the future when AI is able to do everything, there will not be one single super-AI that does it all, but a whole ecosystem of different AI. This is the same as how in the biological world, while there are various degrees of generalists, there's no single cell, plant, or animal which does absolutely everything. If our body needs more blood, it makes more blood cells, it doesn't repurpose intestine or skin for the task.

Similar argument in economics, comparative advantage: an AI which can do everything is best used for the things which only it and no other AI can do, and leaving to other (smaller, cheaper) AI relatively simple tasks like face recognition.

Even where AI can do this, that doesn't mean the best solution is AI rather than a traditional API.

reply
You are dangerously close to dismissing the Bitter Lesson.

https://en.wikipedia.org/wiki/Bitter_lesson

reply
Hardly.

First, last I checked AlphaZero is a much better chess player than any LLM, and by a large margin.

Second, this isn't even about finding the best model for small tasks, it's about best use of finite resources, compute or energy, which means that it still holds even if a future AI (call it Alice) did everything better than AlphaZero does chess, it would still make sense for Alice to offload chess to a merely-good model like AlphaZero so that Alice could spend more time doing the things that nothing else besides Alice could do:

https://en.wikipedia.org/wiki/Comparative_advantage

reply
So the future is about replacing deterministic procedures with stochastic procedures?

On some level you are right, LLMs and the agents built with the various models and architectures will get cheaper. But there are some significant drawbacks by introducing this risk, regardless of cost. The future will need the capacity to understand this too.

reply
Just as likely, as models and harnesses get better with memory, they will recognize the process of building and rebuilding the same tool to complete a task can be optimized by keeping the tool around and using it to deterministically complete the task instead.

This is the process of increasing efficiency today, automate manual processes to reduce human effort. Why wouldn’t models get better at this as well?

reply