upvote
> But it is true that LLMs do reflect human-generated patterns observed in human-generated data.

Overrated. Most training of a frontier LLM is done on synthetic data and reinforcement learning.

reply
Yeah I understand they're not smarter, I'm a SWE and I struggle mainly because as you increase complexity the output goes haywire, and I find managing context + low confidence of output much more exhausting than coding myself, which is why I resolve to AI help when I hit my own knowledge limitations, and basically boilerplate.

With that said, chip efficiency is in the horizon since there's good reason to believe nvidia has just been choking that area of r&d. And then so will models with much larger context. And I personally think that's when it might get scary.

reply
[dead]
reply