I was mildly amused (but not especially surprised) to see that the "Hunter's Vale" initial image includes what's pretty clearly a partial Skyrim HUD compass at the top.
That is impressive. The controls are essentially unresponsive, but the fact that it starts with an image and goes from there bodes well for generative game building.
For those wanting to see it in action, the wait times are wildly inaccurate. Wait five or six minutes and you'll probably get through.
That was terrible. Controls are slow and at times unresponsive. I rode towards a hill that kept getting further away, and tried following a trail that would disappear and reappear. A horse appeared out of nowhere. The terrain detail was hallucinogenic as grass would mutate into different shapes.
Super fun to try a playable world model for the first time! I picked a random picture and got ChatGPT to write a game description, then could move within that world. Very laggy and buggy, but very fun to try!
Hackers screenshot + file system context = Ideal navigation
- Infra/systems: I was able to connect to a server within a minute or two. Once connected, the displayed RTT (roundtrip time?) was around 70ms but actual control-to-action latency was still around ~600-700ms vs the ~30ms I'd expect from an on-device model or game streaming service.
- Image-conditioning & rendering: The system did a reasonable job animating the initial (landscape photo) image I provided and extending it past the edges. However, the video rendering style drifted back to "constrast-boosted video game" within ~10s. This style drift shows up in their official examples as well (https://x.com/DynamicsLab_AI/status/1958592749378445319).
- Controls: Apart from the latency, control-following was relatively faithful once I started holding down Shift. I didn't notice any camera/character drift or spurious control issues, so I guess they are probably using fairly high-quality control labels.
- Memory: I did a bit of memory testing (basically - swinging view side to side and seeing which details got regenerated) and it looks like the model can retain maybe ~3-5s of visual memory + the prompt (but not the initial image).
I picked a Morrowind screenshot of Vivec city and after a few (laggy) frames, it teleported me to a lotr-looking forest and then quickly to a fallout landscape.
Might have potential, but I wasn't terribly impressed by the lack of consistency.
17 comments
[ 3.3 ms ] story [ 180 ms ] threadStarlight Village just has Scar the lion from Lion King right there at the bottom lol
The tech alone of being able to take prefabs and just prompt your way to a world is amazing. Now to get that in blender...
For those wanting to see it in action, the wait times are wildly inaccurate. Wait five or six minutes and you'll probably get through.
Hackers screenshot + file system context = Ideal navigation
https://i.imgur.com/dBXdcd9.png
- Infra/systems: I was able to connect to a server within a minute or two. Once connected, the displayed RTT (roundtrip time?) was around 70ms but actual control-to-action latency was still around ~600-700ms vs the ~30ms I'd expect from an on-device model or game streaming service.
- Image-conditioning & rendering: The system did a reasonable job animating the initial (landscape photo) image I provided and extending it past the edges. However, the video rendering style drifted back to "constrast-boosted video game" within ~10s. This style drift shows up in their official examples as well (https://x.com/DynamicsLab_AI/status/1958592749378445319).
- Controls: Apart from the latency, control-following was relatively faithful once I started holding down Shift. I didn't notice any camera/character drift or spurious control issues, so I guess they are probably using fairly high-quality control labels.
- Memory: I did a bit of memory testing (basically - swinging view side to side and seeing which details got regenerated) and it looks like the model can retain maybe ~3-5s of visual memory + the prompt (but not the initial image).
Might have potential, but I wasn't terribly impressed by the lack of consistency.