Designing a shader using voice and hand gestures (twitter.com)

This is a computer vision experiment, using voice + hand gestures to control a shader animation.

This uses a liquid Chladni pattern, with controls for color and wave frequency / amplitude.

Created using threejs, mediapipe computer vision, and web speech API.