Computer Vision Theremin
Synth and Video Controller (Work-in-Progress)
This project uses open source computer vision, TouchDesigner, MaxMSP and any other software that can ingest MIDI data. Inspired by Leon Theremin’s lesser known terpistone I wanted to make an instrument that would work from the same concepts with modernized hardware and processes.
TouchDesigner paired with IR cameras are used for vector tracking and by utilizing MediaPipe. This information is transported using VLAN to other software such as MaxMSP or VCV Rack. This project outputs standard MIDI data that can then be extended by any program that accepts MIDI and local network access.