Faster MusicGen Generation with Streaming (huggingface.co)

There's no need to wait for MusicGen to generate the full audio before you can start listening to the outputs

With streaming, you can play the audio as soon as the first chunk is ready

In practice, this reduces the latency to just 5s