7 comments

[ 3.3 ms ] story [ 30.3 ms ] thread
LeCun's new paper takes a new approach to building JEPA, which he named LeJEPA -- https://arxiv.org/abs/2511.08544 It's not that different in the underlying theory but he removes the EMA and the twin tower, makes the whole thing more straightforward.
Seems like a pretty good article to sit down and type out the code and spend an afternoon learning.
Are there any pre-trained models / implementations of this, like vllm style, or are we still early into this architecture?

It looks like LeJEPA is sub-1B params and tested on vision tasks? (https://github.com/galilai-group/lejepa)

I had assumed the JEPA family will also be multimodal and agentic capable, perhaps just needs them scaling laws applied?