Ask HN: AWS g6 instances loading into VRAM slowly?

3 points by teaearlgraycold ↗ HN
I'm curious if anyone here would know what the bottleneck is when loading data into VRAM from CPU RAM on AWS. Myself and my teammates are seeing surprisingly slow load times for models. Our local training hardware doesn't have this issue. Would GCP be faster?

0 comments

[ 3.4 ms ] story [ 16.9 ms ] thread

No comments yet.