The remote possibilities here are staggering. If we could send beeps in the human vocal range over phone lines to control things, it could revolutionize telephony!
Yes, I made a game that you controlled by whistling, back in 2018 with the WebAudio API.
My version of the cursor kept a continuous scan velocity horizontally across the screen, and you controlled the y-axis via pitch. Button presses were (intentional) collisions.
Very cool but you wouldn't get very far in an FPS by sending one event at a time. This way you can't did things like strafe turning or shoot while walking.
A flute normally has about 2 octaves of diatonic notes, certainly true for a recorder. I'd suggest expanding the number of usable notes so that some could be used for compound commands.
In saying that, what would be even better, would be to allow the use multiple notes at ones, polyphonic instruments, so that chords could be used for this effect. Say you play a C to walk forwards, a G to strafe right, and E to shoot, then a C major triad could be played to do all these things simultaneously. A flute quartet could maybe play the game together.
Maybe the flute's pitch could be decoded back into the required fingering combination. This way the player could treat each hole as an individual button. The actual notes might not all sound musical (or be properly distinguishable).
That's a cool idea but subtlety of those differences would be much, much more complex to pick up and everything would certainly need to be recalibrated for every different model of flute whereas the current solution would work for flute tuned A=440Hz
This is hilarious. Reminds me of the YID (yelling input device) I made for the stupid shit hackathon in 2018[1]. Playing with alternative ways to control systems is a fun exercise in creativity.
26 comments
[ 2.7 ms ] story [ 53.9 ms ] threadMy version of the cursor kept a continuous scan velocity horizontally across the screen, and you controlled the y-axis via pitch. Button presses were (intentional) collisions.
A flute normally has about 2 octaves of diatonic notes, certainly true for a recorder. I'd suggest expanding the number of usable notes so that some could be used for compound commands.
In saying that, what would be even better, would be to allow the use multiple notes at ones, polyphonic instruments, so that chords could be used for this effect. Say you play a C to walk forwards, a G to strafe right, and E to shoot, then a C major triad could be played to do all these things simultaneously. A flute quartet could maybe play the game together.
[1]: https://github.com/carlsverre/yid
Top comment there is: "The Pied Sniper" (!)
That clip appears to be from https://www.twitch.tv/deanobeano/clip/CharmingDoubtfulCattle... (note: brief profanity at the end of the clip).