Controlling a 3D graph with hand and voice commands (twitter.com) 3 points by getToTheChopin 1y ago ↗ HN
[–] getToTheChopin 1y ago ↗ Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graphCreated with threejs, rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph libraryRuns in real-time in the browser using a regular laptop + webcamLive demo (works best on chrome desktop): https://rosebud.ai/p/557dbe2b-b037-42df-a137-249f8a57341d
1 comment
[ 3.1 ms ] story [ 14.5 ms ] threadCreated with threejs, rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library
Runs in real-time in the browser using a regular laptop + webcam
Live demo (works best on chrome desktop): https://rosebud.ai/p/557dbe2b-b037-42df-a137-249f8a57341d