LiveChess2FEN: Predict live chess games into FEN notation

LiveChess2FEN is a fully functional framework that automatically digitizes the configuration of a chessboard. It is optimized for execution on a Nvidia Jetson Nano.

Automatic digitization of chess games using computer vision is a significant technological challenge. This problem is of much interest for tournament organizers and amateur or professional players to broadcast their over-the-board (OTB) games online or analyze them using chess engines. Previous work has shown promising results, but the recognition accuracy and the latency of state-of-the-art techniques still need further enhancements to allow their practical and affordable deployment.

We have investigated how to implement them on an Nvidia Jetson Nano single-board computer effectively. Our first contribution has been accelerating the chessboard’s detection algorithm. Subsequently, we have analyzed different Convolutional Neural Networks for chess piece classification and how to map them efficiently on our embedded platform. Notably, we have implemented a functional framework that automatically digitizes a chess position from an image in less than 1 second, with 92% accuracy when classifying the pieces and 95% when detecting the board.

The complete source code of the LiveChess2FEN framework is publicly available with an open-source license in our GitHub repository: https://github.com/davidmallasen/LiveChess2FEN

We also have a pre-print article that covers all of the details of LiveChess2FEN: https://arxiv.org/abs/2012.06858

2 Likes

This sounds like a fascinating project. Can’t wait to see further developments of this work using Jetson Nano. Thanks for sharing!

2 Likes