Asking an LLM to play chess by writing algebraic notation is like asking a human to play chess blindfolded.
replyYes some people can do it but most people can't even if they're unusually intelligent.
You really need to be giving the LLM a board representation.
EDIT: I see that they actually were giving the LLMs a board representation and they still played badly. Fair enough then.
If they wanted to train an LLM to play chess they could easily do so.
replyBut nobody wants that.
Very poorly compared to the tools we have built. Similar to the LLM.
replyComparing to raw LLMs? Much much better.
replyPoorly in what sense? I think human chess leagues are way more popular and fun than just playing a computer by yourself. Human oriented communities are always a vastly better experience than their digital counterparts.
replyThere's more to games than simply winning you know.