I think the question is why bother with an LLM if randomness is decisive?
replyJust roll the dice. I mean, it's not the worse you can do to narrow a subset.
right, and it's cheaper, but people want the illusion of determinism. Some people say that they want determinism, but if they do nothing to assure themselves it is deterministic I think it is fair they really only want a good enough illusion.
reply