2 comments

[ 3.1 ms ] story [ 13.7 ms ] thread
> Notably, the cluster used less than 500 watts of power

Still startlingly close to microwave oven wattage.

Noteworthy: this is powered by a new ultra-low-latency userspace TB5 driver offering an ibverbs/RDMA interface over thunderbolt 5[1]. Non-inference HPC workloads could see a massive benefit as well.

[1]: See MLX integration PR at https://github.com/ml-explore/mlx/pull/2808