Can they if they frequently make illegal moves?

No it isn't. Computers could play chess long before LLMs, better than LLMs can in fact. That didn't make them AGI.