I tried to recreate weta’s system for facial performance capture using an helmet camera.
I wrote a simple software in java, based on color blob tracking concepts , that searchs the markers placed on the face and sends their x,y position to maya. These informations are sent with udp protocol, that is faster than tcp/ip because there is no control of the packets.That’s why it’s used for streaming.
The hardware is an helmet camera made by me, using a skater helmet and a hd webcam.
The markers are the blue pieces of scotch tape, for now, but i’m creating a version with blue make up pencil (stolen from my girlfriend
) and 3d head in place of cubes.