Momo

An interative game for a theatre play.

Intro

Momo was a student project for the Mezzanin Theater in Graz Austria. It consisted out of an interactive lobby setup for the Mezannin Theater’s production of Momo (a childrens book by Michael Ende, I love that story btw).

Details to the theatre play can be found here.

The project included a handtracking mini-game and a fotobox. The project was implemented by five students (including me) of the University of Applied Science in Salzburg.

Photobox

The photobox was powered by a Raspberry Pi with a webcam. A Python script was running a OpenGL facial detection to trigger the camera shutter. The taken pictures of theatre guests were later exported to a USB for usage in the play itself.

My contribution on this part was bugfixing and getting things to run on the Raspberry.

The Photobox :)

Hand-Tracking Mini-Game

The Hand-Tracking Mini-Game is a game in which the players hands are tracked and water is spraying from their virtual hands’ palms. The Players have to aim the water to destroy Grey-Men and reach a Highscore. With increasing score phrases from the book are shown on the screen.

The Handtracking is handled by the Google Mediapipe. The python code for this runs in Unity and the resulting data points are visualised in a Scene.

The water simulation is handled by the Zibra Liquid Package.

The sounddesign was handled with fmod.

The Handtracking in Unity :)

My contribution in this was the implementation of the hand tracking with mediapipe.
As well as the scoring system, the configuration system for book quotes that can be unlocked via scores, the highscore saving system and the integration of fmod.

The Handtracking in in Action :)