There's hundreds of gameboy emulators available on Github they've been trained on. It's quite literally the simplest piece of emulation you could do. The fact that they couldn't do it before is an indictment of how shit they were, but a gameboy emulator should be a weekend project for anyone even ever so slightly qualified. Your benchmark was awful to begin with.
replyAs coding agents get "good enough" the next differentiator will be which one can complete a task in fewer tokens.
replyOr quicker, or more comprehensively for the same price.
replyOr the same number of tokens in less time. Kinda feels like the CPU / modem wars of the 90s all over again - I remember those differences you felt going from a 386 -> 486 or from a 2400 -> 9600 baud modem.
replyWe're in the 2400 baud era for coding agents and I for one look forward to the 56k era around the corner ;)
Is such an emulator not part of their training data sets?
reply