Accepted for publication for CHI 2012 (ACM Digital Library)

Use your body as a puppetry controller giving life to a virtual silhouette through acting.


We present a solution that allows real-time interactive control of virtual shadow puppets for performance animation based on body motion.
The interaction with the virtual silhouette with this method is somehow similar to the hand shadow performance, where the performer models his hands to create the illusion of a shape, is like mixing the performance of an actor with the manipulation of a puppeteer.

(more…)

Virtual Marionette is a research on digital puppetry, an interdisciplinary approach that brings the art of puppetry into the world of digital animation. Inspired in the traditional marionette technology our intention is to study novel interfaces as an interaction platform for creating artistic contents based on computer animated puppets. The overall goal of this thesis is to research and deploy techniques and methods for the manipulation of articulated puppets in real-time with low-cost interfaces to establish an interaction model for digital puppetry.

Real-time animation, digital puppetry research for performance animation

Anin-Actor received Honorable Mention for best Breaking Results at ACE 2011.

Honorable Mention

AnimActor: Understanding Interaction with Digital Puppetry using Low-Cost Motion Capture
Luís Leite and Veronica Orvalho

Anim-Actor Poster for ACE 2011

Authors: Leite,  L., Orvalho, Veronica
Year: 2011
This article was published in ACE 2011 (ACM Digital Library)
Anim-actor is an experiment to understand user interaction with biped  puppets using low cost motion capture and is a part of our main research in digital puppetry.

Our goal was to study how non expert artistic (animators, performers, puppeteers) interact with puppets using their body””””s as controllers in different actions and different puppets in particular with 2d / 3d puppets.

We conducted an experiment with 54 participants using the Microsoft Kinect as interface.

The interaction with the 3d puppet was very natural like a player in a motion-driven game or a actor in a motion capture system.

The Interaction with a 2d puppet was a really challenge to the participants because it presented some constraints and didn””””t reflect all the body movements. The participants instead of reproducing the action with their body””””s, tried different approaches, using their body””””s as a indirect controller., like pulling the strings from a marionette or using their hands to produce silhouette shadows . In this way, interacting with a 2d puppets is similar to the marionette manipulation, and the “puppeteer” becomes an interactor.