Recognizing a recording isn't hard to do, because, for the same recording, the chords follow each other with precisely repeatable timing. That's been around for well over a decade. Recognizing a different recording, say, a, cover version, of the same song, is much more work.
Audible Magic claims to be able to recognize multiple performances of the same songs, and even parodies.[1] Using, of course, "AI technology" and much more compute.
Perhaps obviously this is the same technique that enables ACR on TVs.
It occurs to me that Shazam has such a better reputation online because the intent and consent of the user is honored.
It makes me wonder if there couldn’t be an implementation on TVs that is similar and actually is a net positive for consumers. Basically would customers actually like TV ACR if the data wasn’t just going to sell more ads?
I feel like it does not work well. Shazam struggles to recognize music in real life environments that have some background noise, even with a lot of time. It’s much worse than the built in music recognition Google’s phones have, for example.
Might be the best visual explainer of Shazam original audio fingerprinting algorithm from the 2003 paper (I guess they´ve switched to ML models at some point?)
It has been working "fine" for me generally for popular music. But then I was at a ice skating competition where there were some really nice synth:y music going on in the pauses, and I used Shazam on several of the songs, and I tried several times on each. It did not find a single one correctly.
Either this was unreleased music or very small niched music or something, or Shazam totally failed?
> On the flipside, this "fingerprint" approach is also what makes Shazam work poorly if you just sing into it. You're likely to generate different hashes than the original song, even if you are a very good singer! This is why newer, machine-learning-based systems are built to handle humming and singing, by matching on melody rather than exact frequencies.
So this is why singing/whistling a song to my phone never worked! I've always imagined the tech as some sort of wave pattern matching but the DFT is obviously more efficient for many scenarios. Cool article!
21 comments
[ 0.26 ms ] story [ 53.2 ms ] threadFrom CameronMacLeod (2022) - and much more complete analysis (587 points, 2023, 155 comments) https://news.ycombinator.com/item?id=38531428
Or Slate (2009) (50 points, 16 comments) https://news.ycombinator.com/item?id=893353
- OG shazam paper https://www.ee.columbia.edu/~dpwe/papers/Wang03-shazam.pdf (he has a talk on youtube btw look it up if really care)
- https://news.ycombinator.com/item?id=18069968 shazam employee blogpost
- https://news.ycombinator.com/item?id=38538996 shazam cofounder endorsed explainer
- go algo repro https://news.ycombinator.com/item?id=41127726
as with all ML things... the code is much less % of the value than the data...
Audible Magic claims to be able to recognize multiple performances of the same songs, and even parodies.[1] Using, of course, "AI technology" and much more compute.
[1] https://www.audiblemagic.com/2024/02/07/identifying-cover-so...
It occurs to me that Shazam has such a better reputation online because the intent and consent of the user is honored.
It makes me wonder if there couldn’t be an implementation on TVs that is similar and actually is a net positive for consumers. Basically would customers actually like TV ACR if the data wasn’t just going to sell more ads?
https://hn.algolia.com/?q=royvanrijn
It has been working "fine" for me generally for popular music. But then I was at a ice skating competition where there were some really nice synth:y music going on in the pauses, and I used Shazam on several of the songs, and I tried several times on each. It did not find a single one correctly.
Either this was unreleased music or very small niched music or something, or Shazam totally failed?
If any of the authors read this message, please consider adding a RSS feed and you’ve got a subscriber!
So this is why singing/whistling a song to my phone never worked! I've always imagined the tech as some sort of wave pattern matching but the DFT is obviously more efficient for many scenarios. Cool article!