{"id":220,"date":"2012-03-10T19:56:53","date_gmt":"2012-03-10T19:56:53","guid":{"rendered":"http:\/\/richard-deutsch.com\/?page_id=220"},"modified":"2022-01-14T08:45:54","modified_gmt":"2022-01-14T08:45:54","slug":"groupgravity","status":"publish","type":"page","link":"http:\/\/richard-deutsch.com\/?page_id=220","title":{"rendered":"GROUPGRAVITY"},"content":{"rendered":"

GROUPGRAVITY<\/h3>\n

\"\"<\/a>
\nWe build audio and control infrastructure, for interactive performances and installations of many different kinds. Interdisciplinary projects led into collaborations with musicians, circus artists, vj\u00b4s and dancers (find selected performances here<\/a>)
\nOur software translates any \u201cmotion\u201d in real-time into data for controlling sound, light, video, etc.
\nThe system is driven by live-video, the performers are not connected to any wires, sensors, etc.. The program is written in C++ and direct sound and works with minimum latency (already back in 2001, when we came up with it).<\/p>\n

The core of our software, which we call „LiveBuilder“ \u00a0is a real time video motion capture and position tracking software (\u201cVMS unit\u201d).
\nThe software was programmed by Christian Vogel under C++ and developed by GroupGravity
\nuntil the tragic death of Christian.<\/p>\n

The VMS unit is able to control audio and video in a lot of different ways.\"\"<\/a><\/p>\n

\u2022) First of all, LiveBuilder integrates an \u201cextended\u201d sound\/music player which is placed in the main window (Figure 1).<\/p>\n

It can handle 6 sound banks which can be loaded with an unlimited amount of soundfiles. They can be played simultaneously and each sound can be configured with a VST plugin.
\nSound output is based on Steinbergs ASIO interface to achieve best sound quality and minimum latency.
\nAll sound controls (volume, pitch, panorama and VST plugin parameters) can be controlled and connected to the VMS unit.<\/p>\n

\u2022) Additionally all motion and position data (calculated by the VMS unit) can be sent via MIDI to other devices or applications.
\nThis makes it possible to control VJ programs or other applications that respond on MIDI events.<\/p>\n

\u2022) Because of the capability of controlling VST plugins also virtual VST and MIDI instruments can be controlled by the VMS unit.<\/p>\n

\u00a01) The VMS (Video Motion Sensor) unit
\n<\/strong><\/span>
\nThe unit uses any video input device as input (webcam, video camera or camcorder) and controls any parameter of sound or video \u00a0output.
\nFigure 3 shows the VMS window.
\nOn the one hand the VMS window displays the video input, on the other hand virtual lines and fields can be defined that should control sound or video output.
\nA simple vector drawing program is integrated to define easily the lines and fields that should control the sound or video.<\/p>\n

Lines<\/strong> can be used to play, stop and switch between sounds. E.g.: a dancer touches a line and a sound starts to play which is show in Figure 3 and 4.<\/p>\n

\"\"<\/a>\"\"<\/a><\/div>\n
<\/div>\n

If the VMS unit is connected to a VJ program, e.g.: the lines can be used to play, pause or stop a video.
\nFurthermore audio and video output can be synchronized.<\/p>\n

Fields<\/strong>\u00a0can be used to control volume, pitch, panorama or VST plugin parameters of a sound. E.g.: small\/no motion within a field results in a soft sound, fast motion will result in loud sound.<\/p>\n

If the VMS unit is connected to a VJ program, e.g.: the intensity of motion can control the speed or position of a video.<\/p>\n

\"\"<\/a><\/p>\n

The VMS unit supports various modes of position tracking and movement sensoring.<\/strong><\/span><\/p>\n

1.1) Motion capture mode<\/span><\/p>\n

In this mode VMS reacts on movements in the view of the camera. Each frame (picture) is compared with its preceding one.
\nThe amount of change between two frames is calculated and is interpreted as the \u201camount of the movement\u201d.<\/p>\n

1.2) Difference capture mode<\/span><\/p>\n

Difference capture mode is similar to motion capture mode.
\nAt first a reference picture is taken by the camera.
\nThis is usually the basic or mean position of a person or an object.
\nAfter that, each frame is compared with this reference picture.
\nThe further the frame differs from the reference picture the bigger is the response of the VMS unit.<\/p>\n

1.3) Colour capture mode<\/span><\/p>\n

In colour capture mode the VMS unit only reacts on specific colours. These colours can be defined in the VMS window by a normal colour dropper tool .
\nCurrently 3 different colours are supported: The VMS unit compares every pixel with the defined colours.
\nIf the colour of the pixel is within a defined colour tolerance region, the pixel is included in the calculation of the VMS unit.
\nOtherwise the pixel is ignored and has no influence in the calculation.<\/p>\n

\"\"<\/a>\"\"<\/a><\/div>\n

1.4) Combination of motion\/difference and color capture mode<\/strong><\/span><\/p>\n

These modes are equal to motion and difference capture mode (described in 1.1 and 1.2).
\nThe only difference consists in that only objects are recognized that are similar (within a defined color tolerance region) of the selected color.
\nThat means at the example of the juggling balls: if \u201cColor 1\u201d (blue) is selected, only motions of the blue juggling ball will be recognized by the VMS unit and will take effect on audio or video.<\/p>\n","protected":false},"excerpt":{"rendered":"

GROUPGRAVITY We build audio and control infrastructure, for interactive performances and installations of many different kinds. Interdisciplinary projects led into collaborations with musicians, circus artists, vj\u00b4s and dancers (find selected performances here) Our software translates any \u201cmotion\u201d in real-time into data for controlling sound, light, video, etc. The system is driven by live-video, the performers… Read more »<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"http:\/\/richard-deutsch.com\/index.php?rest_route=\/wp\/v2\/pages\/220"}],"collection":[{"href":"http:\/\/richard-deutsch.com\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/richard-deutsch.com\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/richard-deutsch.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/richard-deutsch.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=220"}],"version-history":[{"count":41,"href":"http:\/\/richard-deutsch.com\/index.php?rest_route=\/wp\/v2\/pages\/220\/revisions"}],"predecessor-version":[{"id":2403,"href":"http:\/\/richard-deutsch.com\/index.php?rest_route=\/wp\/v2\/pages\/220\/revisions\/2403"}],"wp:attachment":[{"href":"http:\/\/richard-deutsch.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=220"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}