TiDAR: Think in Diffusion, Talk in Autoregression (arxiv.org)

I've tried dLLMs like Mercury and they look promising.

An update to Gemini diffusion is one of my most eagerly anticipated AI releases. It released to mild fanfare (mostly because you needed to request access to use it), and there has been silence ever since.

Hopefully it's not more Google abandonware, because it was wicked fast and a delight to use

Diffusion is favored by current GPUs .

Over time we seem to have a tendency to build models that are well matched to our machines

That's bizarre because I would expect the opposite. For reasoning you go step by step, and when you're done quickly diffuse the answer