Flappy Bird: Body-Controlled
Flappy Bird, with the player as the bird.
Built for live events and activation booths. A webcam cuts the player out of the background and drops them into the game.
Overview
You see yourself in the game, and your arms do the flapping.
When a player steps up, the webcam takes their photo, removes the background and turns them into the character, animated from a couple of poses. Flapping both arms makes it jump.
The rules are the ones most people already know: pipes, gravity and a score. What's new is seeing yourself on screen, and that's what makes people stop and watch.
How it plays
Three steps, no instructions needed.
- 01Get capturedPress start and the camera takes your photo and cuts you out.
- 02FlapFlap both arms to rise and stop to fall, and fly between the pipes.
- 03Go againA round lasts seconds, and the game resets for the next player.
How it's built
Unity runs the game, and Python does the seeing.
The Unity game captures a frame from the webcam and hands it to a Python program. Using OpenCV and MediaPipe, it finds the player, removes everything around them and returns a transparent image, which the game turns into the character.
While you play, the same program watches the live feed for both hands moving upward and tells the game to flap.
- Unity (C#)
- Python + OpenCV + MediaPipe
- Webcam
- Local socket link
What was hard
Three things that made it hard.
- 01A flap, not a fidgetThe flap had to be detected reliably, while small movements, shadows and changes in light were ignored.
- 02A clean cutoutBusy backgrounds and clothes close to the background colour made the player hard to separate cleanly.
- 03Every player is a different shapeTall, wide and oddly posed players all had to fit the game, so the character is scaled and centred to each one.
Setup
What a stand needs.
- A portrait screen or kiosk
- A webcam facing the player
- One PC running the game and the camera work
- Even light, and a backdrop that doesn't match people's clothes
Bring your own screens and we build for them, or we source and build the hardware as part of the project. Graphics, characters, language and branding are all redone for each client.
Start a project
Have an exhibition or a launch coming up?
Send the date, the venue and what you want visitors to do or remember. We'll come back with an idea for your stand and what it would take to build.