Play the Atari 2600 with a laser gun

How It Works

A Jetson Xavier NX is running the game Atlantis on the Stella Atari 2600 emulator. A projector is displaying the game on a wall.

A camera connected to the Jetson is continually capturing images of the game screen. A thresholding algorithm implemented in OpenCV searches out the red dot of a laser pointer.

A toy gun modified to “shoot” a laser beam is pointed at the game screen. An algorithm implemented in Python matches the coordinates of the detected laser dot with coordinates in the field of game play. When coordinates are within a certain range, actions within the game are carried out by simulating sequences of key presses on the keyboard with the pynput Python module.

More Info