1 comment

[ 2.8 ms ] story [ 11.7 ms ] thread
"Our results show that simple algorithmic improvements can enable significantly more data-efficient pre-training in a compute-rich future."