5 comments

[ 2.7 ms ] story [ 23.6 ms ] thread
It seems like ASR is interpolating the words since at 1:04 it sure does sound to me like Georgi says "yeah, not sure how to feel about this" but it is transcribed as "Yeah, I'm not sure how to feel about this". It also seems to be doing "um" and "uh" suppression, which I can see how that's valuable in some circumstances but "do what I meant" rarely ends well in my experience
ASR systems usually have a language model. It improves accuracy a lot because there are a lot of similar-sounding words hard to tell apart you can eliminate because of context. Depending on the performance, you may have to lean heavily on the language model to get decent results. Even though it sometimes causes errors, it prevents more.
The conversation back and forth with a bit of AI whimsy reminds me a lot of Apple's Knowledge Navigator video: https://www.youtube.com/watch?v=umJsITGzXd0

Siri could've been this but overtime it has become more and more neutered to the point that it feels like talking to a drunken command line interface.

Anyone build this? I'm not familiar with the cmake framework.
I love it, and gg’s work, but damn that latency is painful