Multi-GPU Inference with Accelerate (bengubler.com)

14 points by nebrelbug 3y ago ↗ HN

1 comment

[ 4.2 ms ] story [ 13.9 ms ] thread

nebrelbug 3y ago ↗

Quick tutorial on how to use Accelerate to run inference on LLMs in parallel