Virtual Marionette

OSCeleton2Ramdance 0.1 beta
Jun 2013

This MaxMSP Patch was develop to be able to use the Microsoft Kinect (and more) with RamDance.

Kinect Framework 1: Osceleton->Osceleton2RamDance->RamDance

RAM Dance is an excelent toolkit to create environments for dancers.It is based on OpenFrameWorks so it is possible to modify and create new behaviors.
RAM Dance can also send and receive OSC messages for remote control. This feature presents a great extension to explore.

Although i work with digital puppetry, i found RAM Dance to be a very interesting environment to explore.

By the time this version was finished it was released another application developed by “eight” presenting a easier way to connect Kinect to RamDance. I recommend the use of that application if you are using a MAC and the Microsoft Kinect v1 and don´t want to modify any parameters. If you want to use another operation system, different depth sensor or modify parameters the OSCeleton2Ramdance could be a better choice, why ? Basically because you can modify the patch to meet your needs. For instance: if you want to send the OSC data to other ports and applications it´s easy.

Because OSCeleton send orientation data in a 3×3 matrix i needed to convert this to angle base format (ffff) to be compatible with RamDance that´s why it is included the mat2axis.

Files included in the package
– Folder mat2axis (orientation data conversion)
– max.jar (this is a maxmsp file just to be sure)
– OSCeleton2Ramdance-b01.app (MAC application)
– OSCeleton2Ramdance-b01.maxpat (MAXmsp patch)
– readme.txt (this file)
(MAC or Windows)
What you need:
– You need OpenNI installed (www.openni.org)
– OSCeleton from sensebloom (https://github.com/Sensebloom/OSCeleton)
– Ramdance (http://interlab.ycam.jp/en/projects/ram/ram_dance_toolkit)

How to use:
1. Open Terminal (Mac) or Command Prompt on windows to execute OSCeleton (please read the osceleton read.me file to a better understanding)
You can execute the fowling line: (the ´w´ shows the input image / ´xt´ enables orient data)
./osceleton12 -w -xt -mx 150 -my -150
2. Run the RamDance application
3. Open the OSCeleton2Ramdance-b01 and turn it on

That´s it…

good exploration

DOWNLOAD

OSCeleton2Ramdance 0.1 beta

1 file(s) 7.99 MB

OSCeleton2Ramdance

questions or comments to virtual.marionette@grifu.com

Future Work:
– connect WIImotes to control points of the skeleton
– optimize the patch
– Bridge Output data

João Paulo Seara Cardoso was a portuguese master puppeteer.

He was a storyteller exploring motion to create emotion, using many puppet techniques and performing objects. João Paulo studied puppetry in Institut International de La Marionette and learned with another great masters like Jim Henson. Made many puppet television productions for Portuguese Television like A Árvore dos Patafúrdios

He funded the Teatro Marionetas do Porto in 1988 and kept alive puppetry traditions by performing with Teatro Dom Roberto.

I had the privilege to work and learn with him and his my inspiration for my thesis.

The use of virtual marionettes in television begun with Jim Henson with Waldo.

Fraggle Rock was a television series that applied some of the most advanced puppetry technology

The Doozers characters were Animatronics controlled by remote

Jim Henson was an american puppeteer, probably the most famous in the world.

The creator of “The Muppets” developed puppetry for the television and film industry and pushed the technology beyond limits. Explored advanced puppet techniques in projects like the Fraggle Rock or Labyrinth. He was one of the first to use Virtual Marionettes.

Jim Henson is my inspiration for researching digital puppetry

Stephen Mottram is a british master puppeteer.

Specialized in string puppets, Mottram explores the detail of movement, he created and developed several methods for manipulation using interesting puppet mechanics.

 

Jordi Bertrán is a spanish master puppeteer.

He funded his company in 1987

Always searching for novel approaches. Philippe Genty Puppetry explores the expressiveness of performing objects to create mental images in the audience. Philippe Genty funded in 1968 the Philippe Genty Company.

Michael Meschke his a poet with puppets.

Gives life to puppets since 1958 with the Marionetteatren.

A great master which i had the privilege to meet and learn.

Ubu roi is an incredible creation mixing actors with puppets in a very particular way.

Puppets are made with a bidimentional flat  paper contrasting with the tridimensional volume of the actor.

It was a privilege to participate in the magnificent masterclass of Michael Meschke.

He started by making an overview of his large experience working with puppets and then begun to expose is very particular and interesting point of view of making Puppet Theater, the Why, How and What.
He talked about how and why to choose different puppet techniques; how to give life to a puppet; he shared with us his puppetry principles and finally we had the chance to explore how to create motion with a bunkaru style puppet where groups of three participants manipulated a puppet.

Michael is a puppet poet, he brings magic to the puppet theater.

Thanks to Michael Meschke to share his great knowledge with us.

Michael Meschke at Montemor-o-novo MasterClass

Actor-manipulator relation with the marionette

Michael Meschke born in Dantzig in 1931 and went to Sweden in 1939 with his family.

He started his professional puppeteer carrier, creating in 1958 the Marionetteatren of Stockholm,  an important reference. He funded the Marionettmuseet of Stockholm in the 70´s from his own large  production materials, enriched by acquisitions around the world.