Many people make the mistake to think LLMs are stochastic parrots, but they are more like pianos, you play the keys and they make music, if you don't bring no new spices to the soup no wonder it comes out bland.
replyExactly. LLMs regress to the mean. If you want don't want average, you need to feed the context to push it away from the mean.
reply