Next-Concept Modeling: 9–31× faster than diffusion baselines (github.com) 1 points by allinonai 10d ago ↗ HN
[–] 7e 6d ago ↗ The parallelism is nice, but it only helps cloud inferencers if there is an efficiency improvement. Autoregressive inference isn't parallel, but parallelism can be recovered with sufficient batching.
2 comments
[ 0.74 ms ] story [ 27.4 ms ] thread