There needs to be retrieval, but ranking can be fully offloaded to LLMs and they would probably do better. Legacy search engines do both parts, and their ranking is highly gameable judging by how SEOed they are.
Spoiler: regular search ranking doesn't see very many results, either. I mean, have you seen the results for a crowded query like this? They are trash.