Spot GPU capacity at DO has not disappointed me so far , best thing is the 2 hour reclaim window the fact that I can checkpoint while running our training workloads on the beefy Mi355x is awesome
It depends. GPU capacity is incredibly limited across the space right now.
Vast.ai is a good bet if you need something on demand and are willing to compromise on quality (frequently hosted in non-datacenter environments (non-ideal temps, network, etc)).
EC2 P5 instances are also semi-available (H200 though)
3 comments
[ 1.7 ms ] story [ 16.5 ms ] threadVast.ai is a good bet if you need something on demand and are willing to compromise on quality (frequently hosted in non-datacenter environments (non-ideal temps, network, etc)).
EC2 P5 instances are also semi-available (H200 though)