> If the training set were loaded with Forth, LLMs would be knocking it out of the park.
replyThat is what I thought initially as well, but I'm no longer sure that that is the case. Forth requires a mental model of what is going on on the stack and that mental model can get pretty complex. There is a lot more 'scope' in Forth than in most modern languages, you can reach pretty much any memory location and fetch any word from the stack, effectively the whole machine is in scope.
Which is exactly why this human does not enjoy Forth very much.
replyIt has some interesting properties though. I recently revived a Forth I wrote in 1988 to bring it up to full ANSI compliance and it was a lot of work. It also gave me a renewed respect for the incredibly small footprint that can get you a working forth environment. Originally the program was ~900 lines, and it probably could have been shrunk quite a bit further. But there are a lot of not-so-elegant parts of the standard that caused some bloat.
reply