"Achieving AGI" strikes me as a mostly meaningless phrase. I'm skeptical that it is a boolean event. They're already smarter in some ways, their impact is large and gradually rising, the set of specific tasks that they aren't capable of is gradually shrinking. If AGI means anything useful, it seems like we'll only see it in hindsight and have to argue over when "it" happened.
replyLikewise the singularity. While recursive self-improvement is theoretically trivial (just tweak a random subset of weights like a monkey with a typewriter, eventually you'll get something smarter), the resulting exponential improvement is still very hypothetical and feels unlikely. Unless you're ok with an exponent of 1.000000000000000001.
These are not my stated ambitions, they are the ambitions that Anthropic and Dario have said they are pursuing. Whether or not they are realistic is not relevant to this thread. The credibility of the plans are relevant to the S-1 and anyone who purchases stock from them, but for the purposes of this thread, it is only important that Anthropic believes it has credible chances of achieving this goal, and in particular that it has a competitive advantage, could do so first, and that being first could have a very large upside.
replySorry, I didn't mean to judge your post, I was just going off on a tangent inspired by your post. Mostly unrelated to either the S-1 or Fable 5.2.
reply"smarter in some ways" != "general intelligence"
replyI agree we will only see it in hindsight, but I think that's always the case with any technology. It seems worse until it's suddenly better. I don't think it matters to argue the exact moment though. For example when did cars become clearly better than horses? No one cares about the exact date.
What about the intelligence is not general? What subject is it missing?
replyThe stuff that humans are still smarter at, otherwise it wouldn't be "smarter in some ways".
replyWe are slowly approaching a real definition of intelligence by chanting that llms aren't.
replyAll tools are better than humans in specific, narrow ways. That’s how tools work.
reply