[–] ejro 3y ago ↗ Interesting. This is probably a universal problem for large model training but not being discussed enough.
[–] adeptlo 3y ago ↗ Super interesting problem that's affecting more people than they probably realize.
[–] auraham 3y ago ↗ Interesting post. It would be much better if the author included a few code snippets to show how to identify the failing GPU during training.
5 comments
[ 3.5 ms ] story [ 26.0 ms ] thread