This is AMAZING! What will the brilliant minds at MIT Media Lab think of next? I would love to see this incorporated into a large-format multitouch wall. The guys at Schematic Touch and Monster Media should start playing with this technology right now.
"Singing Fingers" is headed by Eric Rosenbaum and Jay Silver of the MIT Media Lab Lifelong Kindergarten group.
Silver explains how it works:
"While you drag your finger across the screen, your voice or any other sounds in the room are turned into colors on the musical canvas. The pitch of your voice is translated into a color, while the loudness of the sound determines the size. If you start on a blank white space you are recording. If you start on a colored space you are replaying. Use up to five fingers to play back many sounds at the same time, forwards, backwards or sideways."