32 comments

[ 2.4 ms ] story [ 13.6 ms ] thread
What is AMD getting out of this?
Talent and ability to create next gen of multimodal models.
Mostly just 3d world models though, they're not the same as multimodal models.
They're building quite the stack in experimental and ambitious AI model development.

For e.g., they recently acquired Taalas. https://news.ycombinator.com/item?id=49201970

These things are all bets on the future -- and with the World Labs and Taalas acquisitions, in particular, the bet they're making is that conventional LLM development will plateau or become utterly commodified.

I haven't heard about them, I was going to comment about how these reaserchers will get bitter lesson'd, but after looking at what they do, their "world models" are actually transformer models.

This means that the conversation has shifted to the point where we can assume that transforms hold emergent world models (already proven for tiny toy worlds). This is good, because it's probably true.

In any case, this looks awesome and I wish them all the best!

Dr Fei Fei Li's book The Worlds I See is a great read about both her life and the history of early AI and her role in it, which is major (Ilya was one of her phd students, along with the Alex of AlexNet) so if you don't already know the history of these systems, it's a great read. Very inspiring stuff. Great read and learned about it here so passing on the good word
It's a good read but I believe you're mistaken. Ilya and Alex Krizhevsky worked with Hinton.

You might be thinking of Andrej Karpathy as one of Li's more famous PhD students?

yes, thank you for the correction! i read it when it came out, so it's been a while! fun to imagine karpathy labeling images versus what he's doing now!! her first edition (unsigned, tragically) sits on my shelf of reverence!)
Stopped here to say this as well. While he may be lesser-known than the three names mentioned, I’ve been a fan of Justin Johnson’s work since discovering circa ~2019. I believe he is with the WL crew.

Grats to the team.

I believe he is! His lecture series at Stanford on large-scale training was excellent.
(comment deleted)
Doing this on a throwaway to ask some awkward questions.

Way to go and all, and I suppose the investors got an exit but I still scratch my head on this one. We've seen the rise of World Labs from the beginning to this exit, and still the raw output is barely usable for any conceivable use case.

The raw output from these models is very similar or identical to what you can get to generating a splat from a camera that rotates using minimax or other frontier video models.

I work with clients in real world design contexts and the output from world labs was never usable due to all sorts of distortions and errors and stuff.

So again it's cool, but like what was all this hype about? This was usable in a very niche case if you're making video games with no care for spatial continuity and are okay with super heavy assets.

I am surely missing something as I just black box test these things for applicability in the real world, and I just never found any.

Tangent comment, it's so sad you had to create a throwaway here just to express this opinion.

People shouldn't have to be afraid to post what they think of tech topics here (as long as it is not an illegal expression of speech), yet here we are, walking on eggshells.

Yeah sorry guilty as charged -- it's hard because I've met these people IRL and yes I don't want to damage those relationships.

They're super nice, smart and capable folks. But, also as a practitioner in this space the gulf I see between stated capabilities and actual output is super big and I just don't get it.

I'm also worried I'm missing something obvious, like it's me that's the problem and that's embarrassing.

So at least I'll share that anonymously. :/

(comment deleted)
note that unless you've de-anonymized your text - your own idosyncracies might be enough with other clues you've left to figure out who you are IRL
Came here to say exactly this. The way anon writes could be a hint if there are a couple of emails laying around from him/her.
(comment deleted)
If people are really that excited about my identity go for it. I was just trying to be respectful and diminish my criticisms by making them pseudo anonymous.
You didn’t do anything wrong. I was just worried FOR YOU. Sorry if I came across like I was attacking you or blaming you.
No their point is that you should scramble your voice through an LLM for anonymity.
Amusingly, an LLM could probably figure this out in seconds.
If you mean a custom one made for that ... maybe and with a high range of uncertainty.

If you mean any of the big commercial LLMs out there, not even close.

I have to create a throwaway to make this comment: I honestly believe if Fei Fei was a man, she would be getting less scrutiny from the commenters here.
i also would like to know an answer to this
They rode the gaussian splat hype train and their demos look sick. I suspect they had a big marketing push the last 6 weeks because they were looking for an exit.

Apple and Meta are the only two big companies really pushing the frontier of this space, and everyone else is trying to figure out what to do with the technology. World Labs had the best marketing demos and showed the world what you could do with it, but it's all been vaporware from where I've been sitting.

Let's just hope this is not another Magic Leap in 5 years.
Fastest pump and dump ever.

Congrats to Fei-fei on her newly acquired fortune, you can really scam your way to the very top[1].

1: Some might argue it is the only way.

(comment deleted)
(comment deleted)