upvote
Not until power access/generation is MUCH cheaper. Long, long, long way off.

If I can run 50,000 fixed tasks that cost me $0.834/hr but OpenAI is costing $37/hr and the automation takes 40x as long and can make TERRIBLE errors why the fuck would I not move to the deterministic system?

Also, battery life of mobile devices.

reply
These exact arguments could have been made 50 years ago about why laptops are impossible.

But now, we not only have laptops, we run horribly inefficient GUIs in horribly inefficient VMs on them.

The dollar-per-compute trend goes ever downward.

reply
It will never ever be as cheap as as cron job and a shell script. There is a certain limit to how efficient using an LLM to do a job vs using an LLM to create a job is. There is a large distinction in compute and power resources between the two. Don't mistake one for the other.
reply
> It will never ever be as cheap as as cron job and a shell script.

Yes. That's precisely why my company runs dBase 7 on a fleet of old 286DX machine from Compaq. /s

Running obsolete software will be cheaper, but the value provided by the newer technology will make the difference insignificant.

reply
I don't think so, because that carried efficiency scales.

Why do 50,000 tasks with an LLM when I can do 64,467,235 without an LLM that the LLM created for the same cost on probably far lower cost hardware?

reply
If I can run 50,000 fixed tasks that cost me $0.834/hr but OpenAI is costing $37/hr and the automation takes 40x as long and can make TERRIBLE errors why the fuck would I not move to the deterministic system?

Because you'll be outcompeted by people who make the best of the nondeterministic system.

reply