Yeah, LLMs are a solution to the cold start problem plus they are easy to integrate and if you know what you're doing in terms of evals, post processing and so on you can get excellent performance out of them, plus they can do semantic classification and reasoning that you won't get out of some bespoke traditional DS/ML model.

They amortized the creation of corpuses with trainable features, not the myriad of methods that can categorize text with a success rate in the levels required by high-stakes industries.