The chess engine sits on the server keeps all moves legal but Claude will definitely hallucinate some terrible options for you, especially if you're using Haiku. If I had to guess I would say Opus seems to play around at 1200-level game.
It is setup so you could give Claude access to a much better engine to choose moves from though, I just...haven't added that yet :(