His point is that he has read Shakespeare but not the linked article.
replyHe can call on comments from the vasty deep, but shalt we find them relevant?
replyThese are famous games tested here though, and I tried to feed one problem to DeepSeek 4.1 Flash 1017 and it comes back at 66% confidence it is a Pac-Man (incorrect). That smells to me the problem setup heavily hint towards these 2D games. Might be resolution related to be honest.
replyTo be honest I think the experiment would be insanely impressive even if you prompted explicitly that the game is one of 4 options.
replyFrom what I saw in the paper, no they did not. They tested that the specific change introduced increased performance on a single task (the one mentioned in the prompt). They did not study the impact of that change on overall model performance across a variety of benchmarks. But maybe I missed something.
replyBut increasing performance on a single task was the point of the change?
replydeleted
reply