Incidentally, does FF have the "pretty print source file" function somewhere that chrome does? The App.js in this site is minified, making it difficult to set breakpoints.
- The state machine that seems to handle all edge cases, both in things like the tutorial and also in the procedural singing
- The animation, both the rigging (maybe these are bones?) and the spring physics. They blink randomly. Their eyes follow the mouse. Matching the mouths to the vowels and consonants is really well done
- The overall look and feel, including shaders, shadows,
DOF, style, UI overlays
- The synthesizing of a human voice with vowels and consonants in a fairly convincing way. Choir synths for music production can run for thousands of dollars
- The real time harmonizing in a seamless way.
- And on top of all that, it works on all device sizes. It actually runs better on my phone than my laptop, probably due to large monitor size (the bane of any WebGL project).
Yep. I dabble in orchestral music, and was floored that this thing had simple articulations. Entry-level chorale libraries sometimes only have bare vowels, and this thing just... works.
Fun. I wonder how Google decides what projects to choose, the artist behind Blob Opera made something similar back in 2018: https://www.adultswim.com/etcetera/choir/
It's very much a hearts and minds project, with stakeholders in engineering, marketing, press and policy. Each dept uses it to aid their local and regional initiatives. For the first few years it had to fight hard for its existence (originally as a 20% project), scraping budgets together from random sources until stakeholders eventually saw the value.
What's the value if it's gone in 2 years? I wish they'd put similar effort into preserving the app/servers (simple life support) instead of shutting them down.
I enjoyed this, but couldn't get the address bar to disappear on Firefox mobile. Perhaps that's ironic, but I feel like the devs of this have done a great job, and shouldn't be worked about multi browser support.
This is fantastic. The overall experience is magnificantly done. As a Frontend Developer i am really impressed by the sharpness of the UI and the funcionality the interface makes possible. Does anybody know what the Techstack is or where it is posted how the built this?
I don't get it! Can someone explain why/how this is special? Seems like it is only a matrix of like 40 states per blob and that the lower blobs just follows with the same state? Of course well executed but..?
The lower blobs are creating harmonies based on your blob's state. The fact that it produces results that are both musical and interesting is very impressive to me.
I would like to know what the machine learning part of this is. Not knowing any different, and seeing that you can only drag one character at a time, it seems like it could be entirely done with relatively simple harmony rules.
ML or not I still think it's super cool but it would be great to know what's the ML part.
After experimenting a bit, the harmony appears not to be a simple function of the note you play. Perhaps it's taking into account previous notes, and putting harmony in the context of a 'piece'? (that would be cool) Or maybe it's more simply random.
The voices are ML generated based on hours of recordings of real opera singers. It seems that the real time synthesis includes details like realistic switching between vowels, realistic trills on long notes, etc. There's a lot going on to make those voices sound natural.
59 comments
[ 6.6 ms ] story [ 142 ms ] threadIncidentally, does FF have the "pretty print source file" function somewhere that chrome does? The App.js in this site is minified, making it difficult to set breakpoints.
https://twitter.com/thealexweaver/status/1339535386444521472
I still think it's incredibly cool and cute though.
https://taoofmac.com/space/links/2020/12/16/0904
- The state machine that seems to handle all edge cases, both in things like the tutorial and also in the procedural singing
- The animation, both the rigging (maybe these are bones?) and the spring physics. They blink randomly. Their eyes follow the mouse. Matching the mouths to the vowels and consonants is really well done
- The overall look and feel, including shaders, shadows, DOF, style, UI overlays
- The synthesizing of a human voice with vowels and consonants in a fairly convincing way. Choir synths for music production can run for thousands of dollars
- The real time harmonizing in a seamless way.
- And on top of all that, it works on all device sizes. It actually runs better on my phone than my laptop, probably due to large monitor size (the bane of any WebGL project).
Fantastic
Do you have an example? Why are they so expensive, are there no community projects in existence?
I'd guess this is procedurally generated. Different tech.
The graphics are delightful, but the vocals are actually quite crude compared to what's possible, even without any ML.
Two technologies called FOF and PSOLA have been around for decades, and can sound not unlike this.
> the artist behind Blob Opera made
What's the value if it's gone in 2 years? I wish they'd put similar effort into preserving the app/servers (simple life support) instead of shutting them down.
ML or not I still think it's super cool but it would be great to know what's the ML part.
https://www.youtube.com/watch?v=Bht96voReEo