This post collects a series of audiovisual systems that share a similar interaction paradigm, a stretched fabric sensitive to depth. When the audience touches/pushes/pulls the membrane a camera detects the depth variations and responsive visuals are projected in the fabric.
All the following projects are made recently, taking advantage of the Kinect depth camera, however they share an obvious relations with the “Lumigraph” made by Oskar Fischinger in the 40s.( I talked about the “Lumigraph” some time ago in a post related to Colour Organs).
// Oskar Fischinger’s Lumigraph
The Lumigraph was also compose by a flexible screen that hid light beams, by touching the screen it would intersect the light beams and display the colored lights.
"A stretched sheet of spandex acts as a membrane interface sensitive to depth that people can push into and create fire-like visuals and expressively play music. The further you press into the membrane the faster and more intense the piano music becomes. In the instrument mode, the further the membrane is pressed into, the higher the pitch of the sound.”
"The Kinect measures the average depth of the spandex from the frame it is mounted on. If the spandex is not being pressed into nothing happens. When someone presses into it the visuals react around where the person presses, and the music is triggered."
More info here
By Aaron Sherdwood and Michael Pallison
"Screens as they exist today are flat, 2D and rigid; even the 3D displays we have today are not true 3D - they are optical illusions. We created a 2.5D display that is shape changing with the help of actuators, depth cameras, projector and a silicone screen. ‘Obake’ (o-baa-keh) as we lovingly call it, imagines how we would interact with elastic display. We could literally pinch and pull them!"
"Create mountains by pulling them out of the screen, draw rivers with your fingers, elevate an entire terrain to see a cut section view. Make your data come alive. The video shows our working prototype."
More info here.
By Dhairya Dand + Rob Hemsley
CLOUDS PINK EVERYWHERE
The audience is invited to create and interact with the clouds above their head by touching a fabric screen that is suspended in the air. A depth camera in the top captures the interaction with the screen.
"Lying down on a hill with your pupils filled with the endless blue sky, perspective of your eyesight suddenly gets distorted and clouds drift at the tip of your nose. You stretch your arms up to the sky to touch the clouds but can’t reach. Another world right above your head, clouds."
More info here. By Everyware
SOAK, DYE IN LIGTH
"There is an empty canvas glowing in a dark room. When you touch it, it’s elastic surface stretches and gets suffused with beautiful vivid colors just like fabrics absorbing dyes. Poking and rubbing with hands or resting their whole body on this spandex canvas, people can soak this canvas in virtual dyes and create their own patterns. "
More info here. By Everyware