> AWS spot instances for gpu can have availability issues as well or sometimes be priced higher than on demand (still trying to understand that one). You always pay the spot market price, not your bid. Your instance…
Being a dual-GPU model, it really can only fit half the total memory in the majority of cases, because sharing memory across GPUs is far slower and more difficult to implement.
> AWS spot instances for gpu can have availability issues as well or sometimes be priced higher than on demand (still trying to understand that one). You always pay the spot market price, not your bid. Your instance…
Being a dual-GPU model, it really can only fit half the total memory in the majority of cases, because sharing memory across GPUs is far slower and more difficult to implement.