Any time you are doing anything important, where the outcome actually matters. For example, I was recently applying for a study permit and if I generated my application using an LLM instead of consulting with an immigration lawyer and writing it myself, I would not have gotten my study permit. I was recently applying for internships, and if I hadn't paid a real recruiter to review my resume and advise me, I would not have gotten my interview. And trust me, I spent at least an hour trying to get an LLM to generate what I wanted, but no matter how I begged or described what I wanted, it was no use. Good luck fine tuning an LLM to be good at any of this.
> they are getting consistently better
No, they are not getting better, and they will never replace an actual human expert, because a human expert has the actual experience and up-to-date knowledge of what they are an expert at, and also all the complementary context and the current state of affairs in that area. The LLM has none of that.
There are plenty of areas where a "low bar" is more than enough. "low" doesn't necessarily mean bad here, it can simply mean "not the best".
I would argue the majority (in the true sense of the word) of white-collar service work does not require an expert.
It requires someone who has reasonable qualifications in the given field, and the motivation ($) to help you with your task.
So no one needs a top-shelf $900/hour lawyer to draw up a basic low-stakes contract where both parties agree to all the terms as written. You just need someone to ensure that the contract is legally valid as written.
PS: I use LLMs every day, basically let Codex write most of my code (after 15+ years of professional programming), these are amazing tools, smart in some ways, but completely demented in others. People just need to fucking stop being AI doomers and AI coomers. Is this technology great? Yes. Is it worth 10 trillion? Hell fucking no. If we get to a point where RSI is a thing, then maybe. So far it's not a thing and its not even close.