Gesture Arena: A YOLOv8 + TensorRT + CUDA 3D Gesture Battle Game on Jetson Orin Nano

Gesture Arena — Jetson Edition

Hi everyone,

I would like to share Gesture Arena, an Early Access 3D gesture-controlled battle game developed for NVIDIA Jetson Orin devices.

A USB UVC camera captures the player’s hand gestures. YOLOv8 and TensorRT recognize the gestures locally, while CUDA and OpenGL power the real-time 3D battle effects.

Current Features

  • NVIDIA Jetson Orin Nano and Orin Nano Super support
  • Linux ARM64 build
  • Real-time YOLOv8 gesture recognition
  • TensorRT inference
  • CUDA preprocessing and visual effects
  • OpenGL 3D rendering
  • Small Fire and Big Fire gesture attacks
  • Cyberpunk enemy hit reactions
  • Enemy HP and battle HUD
  • Victory, restart and exit flow
  • No cloud inference

Processing Pipeline

Camera Capture
→ V4L2 YUYV Input
→ CUDA Preprocessing
→ YOLOv8 TensorRT Inference
→ Gesture Action Selection
→ CUDA and OpenGL Rendering

Camera Recommendation

For the best compatibility:

  • USB UVC camera
  • V4L2 support
  • YUYV or YUY2 pixel format
  • 1280 × 720 at 30 FPS recommended
  • USB 3.0 preferred

Early Access Release

The current version contains one cyberpunk enemy, one futuristic arena, and two gesture-controlled fire attacks.

Gesture Arena — Jetson Edition is now available for US$6.99 Early Access on itch.io.

Project page:

Planned Improvements

  • Adjustable gesture sensitivity
  • Multi-frame gesture confirmation
  • Improved cooldown and release detection
  • Expanded YOLOv8 gesture dataset
  • More enemies, weapons and arenas
  • Browser and PC editions

Feedback regarding Jetson compatibility, YUYV camera support, gesture responsiveness and TensorRT deployment is welcome.