Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism (github.com) 4 points by yzh 2y ago ↗ HN
[–] ufotalent 2y ago ↗ An interesting playground to understand the scheduler is here https://huggingface.co/spaces/sail/zero-bubble-pipeline-para... [–] QPHutu 2y ago ↗ Cool!
2 comments
[ 5.1 ms ] story [ 21.1 ms ] thread