Same with Safari on MacOS. They're WAV files so it's not a format issue. I can see that the network request fails in the inspector but that's the extent of the debugging work I'm willing to put in this morning!
Unless I missed any this sounds a lot more realistic than existing music-generating models. It's downsampled and can't do lyrics (just vocalizations) but the samples are passable for some muffled song you would hear in the background (e.g. from a passing car)
I'd like to see something like this used to generate an instrument from text. I don't think the 30 second clips are passable quite yet (I do like the simlish-esque vocals though). But I could see this being able to generate wavetables (or other synthesis methods). Generating an instrument from a text description would be very neat. "scratchy violin", "distorted kazoo", "combo violin and slide whistle", etc. It could be an interesting starting point to play with.
I would also propose taking it in the direction of generating synthesizer parameters for a popular VST or Hardware synth instrument. As a musician, it would be very nice to be able to program a synthesizer through plain text as a starting point.
The Spectrogram Model for #23 prompt "It sounds energetic and like something you would hear in clubs." sounds almost EXACTLY like "Psy - Gangnam Style"...
The model is hallucinating what it was trained on.
I mean, I can sort of hear it, but there's enough of a difference that it's still original, if not musically derivative... but this is electronic dance music we're talking about! If people are going to a French House night they expect something musically derivative! The genre depends on seamlessly mixing various works together so there has to be an incredible amount of similarities.
I thought the same exact thing upon listening to #23. It's pretty obviously using elements from it IMO, even though it's layering and warping them. Hard to prove though...
I don't exactly know how to interpret this prompt, and the resulting solo drums meander around as though they don't either. Not really on threes or waltz or 1/3 notes, but a brief tour through all of these and other rhythms.
More artificial Muzak generation that absolutely no one will ever listen to.
My fav is the "hippie coffee shop" jam band clip. That will surely corner the market for Jam band background Muzak at "hippie coffee shops". Total available market of like $5.
At best this new synthesis technique will be an Autechre album.
21 comments
[ 6.1 ms ] story [ 57.6 ms ] threadbut Riffusion[1] uses the spectrogram approach and kind of works.
[1]: https://www.riffusion.com/about
I would also propose taking it in the direction of generating synthesizer parameters for a popular VST or Hardware synth instrument. As a musician, it would be very nice to be able to program a synthesizer through plain text as a starting point.
https://google-research.github.io/seanet/musiclm/examples/
The Spectrogram Model for #23 prompt "It sounds energetic and like something you would hear in clubs." sounds almost EXACTLY like "Psy - Gangnam Style"...
The model is hallucinating what it was trained on.
https://youtu.be/9oCgSE-Le0c
Guilty of terribly trite, cliched and overall bad music, but not guilty of plagiarism.
I don't exactly know how to interpret this prompt, and the resulting solo drums meander around as though they don't either. Not really on threes or waltz or 1/3 notes, but a brief tour through all of these and other rhythms.
My fav is the "hippie coffee shop" jam band clip. That will surely corner the market for Jam band background Muzak at "hippie coffee shops". Total available market of like $5.
At best this new synthesis technique will be an Autechre album.