upvote
What I think is that something the "exponential scaling to AGI" thesis pays too little attention to is resource constraints, and that this is the answer to your question. What will happen if it becomes difficult to sustain the investment of resources necessary to continuously train newer and better models is that the s-curve will start to inflect toward plateau, just like any other technology.
reply
> If the model labs aren't clearly profitable, or open source models eat all the 'model layer' profit - what financial force will push forward very expensive experiments/scaling, etc.?

It's hype - when the hype dies the great push will slow.

My hypothesis is that we'll end up with something like Seti@Home where continued model training gets outsourced to a benevolent appearing product (something like what OpenAI started out as). If I were to bet - Europe and Canada seem best poised (especially the latter) to produce an AGI initiative with a strong ethical focus.

reply
That's a non sequitur. While the frontier LLMs are quite useful for many tasks there's no reliable evidence that scaling them up will ever produce a true AGI. More likely some other fundamental research breakthroughs will be needed, and those breakthroughs won't necessarily come from the current leading companies. I doubt that more money would be necessary or even helpful in that.
reply
There is no reliable evidence they won’t.

Look at rate of progress, not today’s capabilities alone.

The gap is shrinking, many tasks are already performed at super human level.

Humanity doesn’t have monopoly on intelligence - it seems obvious to me it’ll be reached and surpassed without hard upper limit.

reply
OK well then let's check back here in a few years to see if any of them managed to build an AGI. Until then it's just idle speculation. Anything could happen ... or not.
reply
And I’ll bet someone made a comment exactly like yours here, a couple of years ago… and guess what definitely didn’t happen?
reply
First, both of you must agree on one definition of AGI.

I'd be willing to wager that you can't.

reply
reply
I think we have more than 1 data point for AI progress.
reply
Out of curiosity why do you want AGI to ‘happen FASTER’?
reply
Why do you think your life will be better with AGI?
reply
> as someone who wants to see AGI happen FASTER

I think you'll find very few people here sympathetic to misanthropic (ba dum tss) goals like yours. It's evident at this point that AGI will destroy economies, democracy, and upward mobility. There is no Star Trek future. There is only an Elysium future with AGI.

reply