...is like asking your company to maintain its SQL database instead of shoving everything into a document the LLM reads and suggests edits to.
Even if you're using an LLM to talk to the user, there still needs to be some kind of deterministic search engine back there in order to do things well, or to answer any kind of question that involves information newer than X months ago.
If someone searches for "mexican food" you require ranking anyway because you aren't going to load those ten bazillion hits into the LLM first.