Something’s way off with these numbers. The page says it encodes video at 640MB/s which is quite large even for 4D data and doesn’t match the filesize of the demo splat (7.4MB / 2sec, or ≈3.4MB/s).
A gaussian gif. Coming to porn sites soon. The file format name works for them. But imagine whole movies shot in this format. The fly-on-the-wall fantasy of movies, without being locked in place for the whole shot. Narrative possibilities like being able to examine just how close the Tyrannosaurus Rex is to your rear view mirror.
I hope this catches on just to be able to watch the evolution of cameras to capture it.
Ok but you're commenting on the general concept of animated gaussian splats. That's existed for a while and it's unrelated to what this actual post is about which is a new compression method.
>imagine whole movies shot in this format. The fly-on-the-wall fantasy of movies, without being locked in place for the whole shot.
That would be terrible. Framing is the major expressive feature in cinematography, and any interactive format needs a lot more thought put into it than a free camera. Literally the worst of both worlds.
Light field video streaming is a thing, however it's pretty niche. OTOY pioneered light field videos with some degree of freedom and a sense of depth more than a decade ago.
But a free camera actually makes sense in certain scenes, like being in an open area. A marketplace bazaar will feel a lot more immersive. You could also make a scene like that have many points of interest. That part of the movie would really feel like, I don't know, going to the mall with all the characters.
That already exists though. I believe Braindance VR uses a rig with a couple dozen cameras to capture the same scene from multiple viewpoints then converts it to a gaussian splat that can be walked around.
Its great for porn for those videos when the camera seems to be focused on the actors balls when thats definitely not the part I want to be looking at. I can just look around the room instead.
A$AP Rocky did it for a music video. Granted, it was only used for the editing process and not the final video, but it still presents some interesting opportunities, though it doesn't really look real so the applications may be limited.
What exactly is novel here? The specific implementation/application? All of the employed techniques are well-established, some are decades old.
Any newly written software is novel in regard, unless you copy someone else's homework verbatim.
If this is your area of research you will find nothing interesting here. I suggest removing "novel" from the title unless you wish to seriously disappoint some people.
52 comments
[ 3.5 ms ] story [ 36.0 ms ] threadYes please give me the latest supply-chain attacks.
I hope this catches on just to be able to watch the evolution of cameras to capture it.
That would be terrible. Framing is the major expressive feature in cinematography, and any interactive format needs a lot more thought put into it than a free camera. Literally the worst of both worlds.
Light field video streaming is a thing, however it's pretty niche. OTOY pioneered light field videos with some degree of freedom and a sense of depth more than a decade ago.
https://radiancefields.com/a-ap-rocky-releases-helicopter-mu...
Any newly written software is novel in regard, unless you copy someone else's homework verbatim.
If this is your area of research you will find nothing interesting here. I suggest removing "novel" from the title unless you wish to seriously disappoint some people.
https://webgpureport.org/
What is up with LLMs and "iff"?