COLLISIONcollective

**************************************************************************************************************************************************
*                                                                                                                                                *
*                        For engineers that moonlight as artists and artists that moonlight as engineers                                         *
*                                                                                                                                                *
**************************************************************************************************************************************************
*                                                                                                                                                *
*   CCC    OOO    L      L     IIIII    SSS     IIIII    OOO    N    N                   l     l                      t      i                   *
*  C   C  O   O   L      L       I     S   S      I     O   O   NN   N                  ll    ll                      t                          *
*  C      O   O   L      L       I     S          I     O   O   N N  N    ccc     ooo    l     l     eee     ccc    ttttt    i    v   v    eee   *
*  C      O   O   L      L       I       S        I     O   O   N  N N   c   c   o   o   l     l    e   e   c   c     t      i    v   v   e   e  *
*  C      O   O   L      L       I         S      I     O   O   N   NN   c       o   o   l     l    eeeee   c         t      i    v   v   eeeee  *
*  C   C  O   O   L      L       I     S   S      I     O   O   N    N   c   c   o   o   l     l    e       c   c     t      i     v v    e      *
*   CCC    OOO    LLLLL  LLLLL IIIII    SSS     IIIII    OOO    N    N    ccc     ooo   lll   lll    eee     ccc      tt    iii     v      eee   *
*                                                                                                                                                *
**************************************************************************************************************************************************

JitterBot - A Dialog in Dance

Computer with custom software, video projector, Kinect interface
2012
Rob Gonsalves: JitterBot - A Dialog in Dance

Overview

JitterBot is an interactive installation that allows visitors to dance with a virtual robot. This piece explores the threshold of leading / following in dance, allowing the participant to have a dialog with a technological being, using their bodies as the means of communication.

Song Selection

The user chooses a song by raising an arm and pointing to one of the seven original compositions. The computer uses a motion tracking interface and custom software to choose the song.

The Dance

The user is invited to dance along with JitterBot, the red robot. The user's movement is tracked using the tracking interface and displayed on a projection surface as the green robot. Sometimes JitterBot follows the visitor's lead and sometimes JitterBot busts a move on its own, for the visitor to follow.

The Setup

The installation is centered on using the Microsoft Kinect sensor which allows for real-time full-body 3d motion capture. A layer of custom software interprets the 3d skeleton of the viewer and renders a stylized human form, the green robot. The movement of the red robot is driven partially by the viewer's motion, but it is also driven by a library of canned moves to give a sense of autonomy. The two robots are rendered as a series of elongated spheres using OpenGL. The resultant video image is projected on a screen on the wall, and the accompanying music is played through speakers.

More info is available here:

http://robgon.com/Details.aspx?work=jitterbot

Search
User login
Latest Blob Posts
COLLISIONcollusion
Syndicate
Syndicate content