> The question is mostly why wasn't this productized.

Probably because doing it wrong (using an llm in place of a classifier) is more profitable? (For the people selling inference.)