Have you ever let the LLMs “discuss” with each other to see if that would give better answers?
replyYou might end up with the answer from the most persuasive LLM, but you might also end up with better results.
Wonder if there is a paper out there on this.
The problem with trying to write a paper is the results depend on RNG.
replyThe problem is how do you know whether the answer is just the most persuasive or actually the most accurate one? It's hard to figure this out without domain knowledge.
reply