Seems like we should fix the LLMs instead of bending over backwards no?
replyThey’re good at it because they’ve learned from the existing mountains of python and javascript.
replyI think the next big breakthrough will be cost effective model specialization, maybe through modular models. The monolithic nature of today’s models is a major weakness.
replyPlenty of Java in the training data too.
reply