event
Synthux Hackathon 2024

Μῦς (Muscle)

"Mys": A wearable sensing system that translates movement into visuals and sound.
Daisy seed microcontroller
TouchDesigner
MaxMSP
Arduino
HTML/CSS/JS
Gyroscope/Accelerometer
Camera feed
Arduino Uno
prompt

Coaches & collaborators

Karl Yerkes, Graham Wakefield
institute
University of California Santa Barbara
"Mys" is a wearable sensing system that enhances human perception and interaction with intelligent environments. Human movement is captured with three accelerometers and translated into extended reality architectural transformations. Kinesthesia is analyzed into a unique inkblot signature via artificial intelligence diffusion models, which is then projected back onto the individual. "Mys" offers a visionary glimpse into the future of augmented interactions between biological and machine intelligence, fostering a deeper, more immersive connection between humans and the spaces they inhabit.
No items found.
the tech

How does it work?

Three-dimensional sensor data drive three sinusoidal oscillators within MaxMSP and high-pass and median filtered to remove noise. Vector magnitude calculations modulate the envelope, and each sensor axis controls the pitch, duration, and reverberation parameters. Utilizing diffusion AI models within TouchDesigner and a custom .tox developed by dotSimulate, live camera feed generates dynamic ink blots. Wearable components were designed using Rhinoceros, prioritizing flexibility by printing onto tulle fabric overlaid onto 3D printed layers. The final housing design uses a procedural mesh system, made in Blender, and printed with a Bambu Lab X1-Carbon Combo 3D printers, supplied by SBCAST.
Open source code
Click here to grab this project's code
Daisy seed microcontroller
A powerful microcontroller for synthesis programmed through C++, Arduino, Pure data and Max MSP
TouchDesigner
Node based visual programming language for real time interactive multimedia content
MaxMSP
Visual programming language for music and multimedia
Arduino
Development board
HTML/CSS/JS
Gyroscope/Accelerometer
A gyroscope/accelerometer is a device used for measuring or maintaining orientation and angular velocity
Camera feed
Arduino Uno
Development board
About the instrument
we're using cookies to run our site. privacy policy.