7 comments

[ 88.8 ms ] story [ 1218 ms ] thread
Sora in this case really has nothing to do with the model, as OpenAI hasn't released any specific details about the model, we only know that it's a diffusion model using a transformer architecture and it was trained on videos of different dimensions and lengths, this is just an open source text-to-video.
It's OK. The text-to-video realm won't be solved by a single solution. There's simply too many applications. Exciting times.
Seems a bad idea to call it Sora given that it has nothing to do with OpenAI Sora (other than achieving a similar goal). Also a trademark violation probably.
Also just a really bad word to combine with "open". Lots of emphasis necessary on that final "a", lest only the first syllable registers.
I wonder if it would have even been posted, if not for the misleading name.
is this the open source state-of-the-art for video generation?
I imagine it would be the Stable Diffusion Video model.