Virtual Marionette

Real Time 3D Puppet Animation

reActor

reactor

reActor – real time 3d puppet animation using a low-cost motion capture system based on the Microsoft depth camera.

Using body movement for controlling a 3D virtual marionette.
This is a low-cost animation solution for performance animation (real-time productions)

Hardware:
Microsoft Kinect depth camera for mark-less motion capture (accessible and simple calibration)
Macbook with OSX 10.6

Software solution:
OpenNI framework
Avin PrimeSense for skeletal model
SenseBloom OSCeleton for joint information transmission via OSC protocol
Autodesk Maya for character modeling
Unity game engine for real-time animation with OSC data

Video Demonstration

INTERFACE: Microsoft Kinect

(more…)

Real-time Puppet Animation with Kinect

Virtual Silhuette

Real-time puppet animation with low budget motion capture solution using the Microsoft Kinect connected to a macbook.

The workflow for this project is based on the OpenNI driver frame work, using SensorKinect, the AVIN hacked PrimeSense driver for kinetic supporting OSX.

The OSCELETON from Sense Bloom routes the skeleton information through open sound control messages. This information reaches the real-time animation software ANIMATA giving life to the Silhouette.

This demonstration is part of a research project on real-time puppet animation called Virtual Marionette.

credits:

Silhouette figure – Luís Silva

Demonstration+Music – Grifu

Video Demonstration

INTERFACE: Microsoft Kinect

using Arduino as Interface

ARDUINO + MAXMSP + MODUL8 = REAL-TIME MANIPULATION / ANIMATION

arduino

Low budget solution for real-time manipulation for live performance contents.
Using some analog knobs connected to a Arduino board that communicates to MaxMsp witch translates the data to Midi messages mapping those to functions in Modul8.

2010, video example of real-time manipulation

download video at full size (720×576 – 68Mbytes) arduino

or view the stream version above

Video Demonstration

(more…)

Virtual Puppets

animatic

Animatic – realtime puppet animation

A Virtual puppets system with special focus in the puppeteering art using several ways of interaction as a way to recreate the diferent styles of puppetry, including marionettes and rod puppets.

Video demonstration

INTERFACE: Wiimote, microphone, gamepad, keyboard, mouse

(more…)