Fully Sharded Data Parallel: Faster AI Training with Fewer GPUs (engineering.fb.com) 3 points by TheGuyWhoCodes 5y ago ↗ HN
2 comments
[ 3.3 ms ] story [ 15.4 ms ] thread