> You could turn clothing descriptions into embeddings and have a fashion vector database

Well, that assumes descriptions are extremely accurate down to the last seam, which is not true. You'd be better off considering reviews and photos, esp. user provided photos, you also need to take into account the model/s in the photos are not necessarily shaped the same as you, so you need to somehow counter that bias in training. This is simply not a task achievable with current ml techniques, however again, feel free to prove otherwise.

(and ftr, I'm of course making a basic assumption that we're past the topic of markov chain/'llm' based chat bots at this point? Those are completely irrelevant to the goal of categorizing clothes based on some characteristics [i.e. the so-called 'vibes'])