Google says 3e-4 is the best lr for Adam (misinterpreted Karpathy's joke) (google.com) 1 points by vukadinovic 4y ago ↗ HN
[–] vukadinovic 4y ago ↗ Google misinterpreted Karpathy's (joke) tweet, and by searching " what is the best learning rate for adam optimizer " says that " 3e-4 is the best hands down ".
1 comment
[ 3.0 ms ] story [ 12.3 ms ] thread