This is a game developed with Java, kinect and 3D Maya with Simone Carcone, Giulia Dell’armi and Adriano Muraca: Let’s Make guys. We have created this for Let’s Make innauguration to entertain people who come.
I tried to recreate weta’s system for facial performance capture using an helmet camera.
I wrote a simple software in java, based on color blob tracking concepts , that searchs the markers placed on the face and sends their x,y position to maya. These informations are sent with udp protocol, that is faster than tcp/ip because there is no control of the packets.That’s why it’s used for streaming.
The hardware is an helmet camera made by me, using a skater helmet and a hd webcam.