SYNORA
GESTURE MUSIC STUDIO
Turn your hands into an expressive musical instrument. By pairing high-speed MediaPipe 10-Finger tracking with Tone.js synthesis and Three.js reactive 3D visuals, SYNORA lets you play melodies, trigger beats, and sculpt soundscapes right in the air.
From Hand Motion to Sound in Milliseconds
Experience ultra-low latency music creation. All video analysis and audio synthesis run 100% locally in your browser.
Local Webcam Feed
High-framerate video capture streamed straight to client memory. Zero video frames leave your computer.
MediaPipe Tasks Vision
Simultaneous 2-hand detection tracking 21 3D landmarks per hand with exponential smoothing filters.
10-Finger Gesture Engine
Hysteresis-debounced pinch detection, finger distance calculations, and coordinate velocity tracking.
Tone.js Audio Synthesis
Polyphonic synths, drums, bass, and an FX chain (Reverb, Delay, Filter, Chorus) produce zero-latency audio.
Three.js Reactive 3D
Dynamic particle vortex pulses to real-time audio FFT frequencies and expands upon note pinches.
Play With Simple Hand Gestures
No physical instruments or MIDI keyboards required. Your hands become the ultimate expressive controller.
Pinch
Bring thumb & finger together to trigger notes, strike drums, or activate synth voices.
Point / Hover
Glide fingers across the camera field to select pitch notes and navigate scales.
Open Palm
Spread all 5 fingers to sustain chords and create ambient harmonic soundscapes.
Fist
Curl all fingers into a fist to immediately silence all ringing voices (Kill Switch).
Hand Position
X-axis modulates melodic pitch while Y-axis sweeps lowpass filter cutoff and resonance.
Four Expressive Music Modes
Whether you want to play a classical keyboard, finger-drum, sculpt synth leads, or compose full songs.
Piano & Harmony
Right hand plays pentatonic melody notes while the left hand triggers accompanying chords and deep resonant bass notes.
Beat Machine
Both hands transform into a 10-finger percussion kit: Kick, Snare, Hi-Hat, Clap, and tuned Percussion at your fingertips.
Cyber Synth
Continuous X/Y parameter control. Horizontal movement sweeps through scale pitches while vertical movement modulates resonant lowpass filters.
Composer
Record live gesture events with microsecond timestamps, visualize on the interactive beat timeline, and play back or save your tracks.
Ready to Play Music in the Air?
Open your webcam, raise both hands, and start sculpting beats and melodies immediately. No downloads or sign-ups required to test.