upvote
The point I think is interesting is that this is just 7B. The current SOTA 7B LLMs are barely usable for quite simple coding.
reply
Text is in a sense way harder to do than images because of radical nonlocality. A word at the start of one paragraph can directly influence the meaning of a word five paragraphs away. Whereas images typically represent the real world, or at least a spatial domain, which gives you a lot of structure 'for free'. If you are drawing a human, you can make a reasonable guess where their hands go in relation to their face. If someone hands you the first half of an essay, finishing it is not trivial.
reply
To generalize, LLMs are great at what you are not skilled at.
reply
That's how they're sold, isn't it?
reply
Well, not exactly. Many, many companies and managers think that they can replace skilled people or have unskilled monitoring them.
reply
That's a fair statement, I agree. I'm quite an abysmal artist so I could be a victim of my own bias here
reply