Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio (machinelearning.apple.com)

MLX has been an absolute gamechanger for local AI.

[flagged]