HN Explorer

true2octave

↗ HN profile [ 66.7 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. Ask HN: How do AI labs setup their infrastructure to train large models?

    At my company I have to do this task, and so far I have seen slurm-based cluster setup (v100s or h100s), some fast distributed file system, Docker for containers and PyTorch with DDP strategy. But I read somewhere…

    3 points 0