It feels to me like the advancements are not accelerating, though, like we're nearer the top of the S-curve than enthusiasts think we are. A lot of the recent advances seem as much a harness improvement as an actual model improvement. We've made exceptional progress in the last couple years, but spent an exceptional amount of money to do it. A moon shot, basically.
replyHonestly, my gut feeling (worth every bit of what you are paying for it...) is that until we get actual intelligence instead of a good facsimile, we're not looking at an existential problem or a UBI-level problem, even, just a big change in tooling.
Hey I hope you are right. I, like so many of my fellow engineers, am not exactly thrilled at the prospect of my role changing from underneath my feet and the uncertainty that comes with it.
replyWe are making steady progress. It’s not exponential per se like we used to see but in my experience models are steadily getting better. Also breakthroughs can be sudden.