2 comments

[ 1542 ms ] story [ 760 ms ] thread
Reducing dropped tokens could also improve model training by reducing gradient noise