Makes sense, dense for small models, dense or MoE for larger ones, end up fitting various hardware setups pretty neatly, no need for MoE at smaller scale and dense too heavy at large scale.
replyI never want LLM to span me with emojis. What is the use case for that?
I find it highly annoying.
replyShh people are paying for each token. Don't get them asking too many questions
replyThink it can be a plus in moderation. eg in openclaw it can add some character
replyBut yea dislike that style where each heading and bullet point gets an emoji