Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism (github.com) 4 points by yzh 2y ago ↗ HN
[–] ufotalent 2y ago ↗ An interesting playground to understand the scheduler is here https://huggingface.co/spaces/sail/zero-bubble-pipeline-para... [–] QPHutu 2y ago ↗ Cool!
2 comments
[ 2.6 ms ] story [ 13.4 ms ] thread