Some open source codes to recognize gesture and hand tracking. The url for the controller:
https://github.com/monlim/Handmate-MIDI

Here is the demo:

Here is another demo to control audio effects directly in the browser. You can even load your own samples.

The codes, https://github.com/monlim/Handmate-MIDI

EDIT: Removed youtube redirecting.

 

Last edited by a moderator: Dec 26, 2021

Really cool stuff

Edited: Holy cow, only needs the browser. As a proof of concept is awesome. But it must run slow

 

Been doing stuff like this for over 10 years probably longer, it's not new.
Can trigger a drum machine and programme in step in the same way.
Obviously it's growing with additions, but it's old.

 

How fast it is?

 

As fast as Jean-Michel Jarre's 'hand through light to trigger MIDI/CV Gate keys' schtick from the 70s/80s? lol (Which was fake anyway!)
I really don't know.
As instant as tapping the drum pad in real life anyway.