Today i'm releasing chess-autocomplete, a new state-of-the-art for human move matching accuracy in chess. A chess bot that plays like a human, trained on 1.76 billion chess games.
In this blogpost I walk you through the full process from having an idea, creating a dataset, designing evaluations, and finally training a new state-of-the-art transformer model.
The methods used here have close parallels to how LLMs are trained, so if you're curious about them give this a read.
Everything is open-source:
- The datasets
- Training and inference code
- The final weights for all three model sizes
- Training curves
- Model checkpoints at multiple stages of training
PS: Want a challenge? Try beating the model, you can play against it in the blog post.
2 comments
[ 2.1 ms ] story [ 12.6 ms ] threadIn this blogpost I walk you through the full process from having an idea, creating a dataset, designing evaluations, and finally training a new state-of-the-art transformer model.
The methods used here have close parallels to how LLMs are trained, so if you're curious about them give this a read.
Everything is open-source: - The datasets - Training and inference code - The final weights for all three model sizes - Training curves - Model checkpoints at multiple stages of training
PS: Want a challenge? Try beating the model, you can play against it in the blog post.
2026 https://www.youtube.com/playlist?list=PLBRObSmbZluQwBIvxyiWf...
2025 https://www.youtube.com/playlist?list=PLBRObSmbZluRddpWxbM_r...