Show HN: Stop GPU pods placement getting bottlenecked by reserved VRAM

2 points by medicis123 ↗ HN
We have built a GPU Runtime for Nvidia GPUs that can run multiple development/experimental/inference workloads per GPU with safe overcommit of VRAM, dynamic fractional allocation of GPU cores, and Deduplication of weights in VRAM.

We are looking for teams to give it a try.

More details to get a trial license - https://www.woolyai.com.

0 comments

[ 0.30 ms ] story [ 7.9 ms ] thread

No comments yet.