What was done is more like using the LLM as a personal assistant that doing long manual labor to find what you might be looking for.
This way of shopping is already a thing. "Hype and investment" goes into how the companies can monetize AI harder (ads! integrated LLM shopping! business development! premium pro max enterprise data policies!), it doesn't really focus much on how the individual can save time and money through non-flashy tasks.
Well, that assumes descriptions are extremely accurate down to the last seam, which is not true. You'd be better off considering reviews and photos, esp. user provided photos, you also need to take into account the model/s in the photos are not necessarily shaped the same as you, so you need to somehow counter that bias in training. This is simply not a task achievable with current ml techniques, however again, feel free to prove otherwise.
(and ftr, I'm of course making a basic assumption that we're past the topic of markov chain/'llm' based chat bots at this point? Those are completely irrelevant to the goal of categorizing clothes based on some characteristics [i.e. the so-called 'vibes'])