Assuming no new paradigms on the hardware side that no longer fit into our current programming models, do they? Rails' claim to fame was eliminating "XML sit-ups" to improve the developer experience, but who cares how many "sit-ups" LLMs need to do?
At large enough scale, I suspect it'll become a problem. At the moment part of the appeal is how effortlessly models absorb menial work, but I do wonder if eventually it'll be too wasteful at large scales to sustain it. Maybe not, though.