Oh well, LLMs are notoriously bad at chess. Other tasks as well. Maths, especially counting... But I'd say this is because they're not very intelligent. And not trained to be a chess computer. So a clever middle-school kid will outperform them at chess. Or a kindergarden kid at counting letters in words. But that doesn't directly lead to the conclusion they're not world models. That'd conclusion needs some qualifying, quantification and a mathematical proof. This is just opinion.