event
Synth Design Hackathon 2023

HandMod

HandMod is an interactive sound and light installation which offers the user control over sound colours and light.
MaxMSP
Ableton
Teensy Microcontroller
prompt
A subtle stirring
category
Art installation
category
Art installation

Coaches & collaborators

institute
SRH Berlin university of applied sciences
HandMod is an interactive sound and light installation which offers the user control over sound colours and light. With subtle movements and stirrings of one hand, sounds can be interchanged and modulated, filters can be applied and arpeggios faded in and out, while on the other hand , the ‘CTRPLR` controller' offers quick and direct control over Ableton Live functions. The Concept is to simultaneously control sound and light through the movement of one Hand in front of the camera. It gives everyone the ability to perform or explore live music and sound. You are able to manipulate the background sounds as well as add more parameters or control volume by using the MIDI Controller with the other hand if you choose.
No items found.
the tech

How does it work?

We used the n4m Handpose Max application from lysdexic-audio to capture data points from Hands through a webcam. The Data points are used to control the Macros of an Instrument Rack in Ableton which in turn modulates several channels and parameters of synthesizers and effects. This gives the user 4 zones (UpLeft, UpRight, DownLeft, DownRight) to change and crossfade sound. We were able to send Data from the Handpose patch to resolume in order to control Lights (launching Clips and changing parameters). Sadly our machines were not powerful enough to run everything at the same time.
Open source code
Click here to grab this project's code
MaxMSP
Visual programming language for music and multimedia
Ableton
Music production program
Teensy Microcontroller
About the instrument
we're using cookies to run our site. privacy policy.