Skip to content

Fruit Ninja: Hand-Tracked

Fruit Ninja, sliced with your bare hands.

Built for events, exhibitions and malls. A webcam tracks the player's hands, and each hand becomes a blade.

Year
2025
Setting
Event, mall
Input
Webcam hand tracking
Visualisation of the hand-tracked Fruit Ninja wall
Visualisation. There is no event footage of this one yet.

Overview

Swipe through the air and the fruit splits on screen.

Players stand in front of a screen and move their hands. Two blades follow them one to one, left hand and right hand, so a swipe in the air slices the fruit flying past.

Fruit bursts with juice and adds to the score. Hitting a bomb ends the run at once. Rounds are timed, so the line keeps moving.

How it plays

Three steps, no instructions needed.

  1. 01Raise your handsThe camera finds them and puts a blade on each.
  2. 02SliceSwipe through the fruit. Juice and sound confirm every hit.
  3. 03Avoid the bombsHit one and the round is over, and the next player steps up.

How it's built

Python follows the hands, and Unity runs the fruit.

A Python program reads the webcam with MediaPipe and finds both hands in every frame. It sends just their positions to the Unity game many times a second, smoothed so the blades don't shake.

In the game, fruit is thrown up in random arcs. When a blade crosses one, it splits, bursts and scores.

  • Unity (C#)
  • Python + OpenCV + MediaPipe
  • Webcam
  • Local socket link

What was hard

Three things that made it hard.

  1. 01Finding hands anywherePoor light, fast movement, noisy backgrounds and other people in the frame all make hands hard to track.
  2. 02Smooth, but not lateRaw tracking jitters. Smoothing it out mustn't make the blade lag behind the hand.
  3. 03Swipes faster than a frameA fast swipe can jump past a fruit between two frames, so the hit areas had to be built to catch it.

Setup

What a stand needs.

  • A large screen
  • A webcam facing the player
  • One PC running the game and the tracking
  • Room to swing your arms

Bring your own screens and we build for them, or we source and build the hardware as part of the project. Graphics, characters, language and branding are all redone for each client.

Start a project

Have an exhibition or a launch coming up?

Send the date, the venue and what you want visitors to do or remember. We'll come back with an idea for your stand and what it would take to build.