upvote
I don't think we'll see a world where local llms are capable of diffing a file in the millisecond timescale that current diffing does.

Same for most things. How long does it take some juiced up llm to build an mp4 renderer? Can it do all of that in the milliseconds it takes mpv file.mp4 to display it's first rendered frames?

What about a video game? How long would it take the god of all AI, running on local hardware, to build and launch GTA 6? Could it do so in less than the ~4hour download and ~1 hour install? Could it do so in less than the hour install if I didn't have it installed? Could it build and launch in less than the ~minutes it would take to launch if I'd already downloaded and installed it?

Suppose in this future someone else runs their llms for many days/hours/weeks across many agents totalling perhaps years of clock time. They have a game/program that does something I'd like to do/play, and it sits in say a terabyte of space. The only way me using my agents instead of downloading their file makes sense is if I have so vastly much more compute than them that I can complete what they did in days/hours/weeks in around a day (assuming my internet somehow stays pegged to 100mb/s in this future), because I can download a terabyte in 24 hours.

reply
Speaking of GTA 6 ... I'd buy that game if the non-player characters had capable AI, like an LLM agent.
reply