Instrumentation checklist for running large GPU clusters (together.ai) 2 points by amaldavid 1y ago ↗ HN
[–] amaldavid 1y ago ↗ Just stumbled upon this blog which details out testing and validating large GPU clusters before running training workloads. Any other similar blogs which adds more nuance in terms of debugging the issues once we identify them as well? [–] roanakb 1y ago ↗ this is a good one for debugging rdma: https://docs.redhat.com/en/documentation/red_hat_enterprise_...
[–] roanakb 1y ago ↗ this is a good one for debugging rdma: https://docs.redhat.com/en/documentation/red_hat_enterprise_...
3 comments
[ 2.0 ms ] story [ 14.5 ms ] thread