[–] nyoncore 2y ago ↗ Isn't it obvious that since LLM are trained to predict the next word they do better than to predict the previous one? [–] [deleted] 2y ago ↗ (comment deleted) [–] frotaur 2y ago ↗ In the paper it is mentioned that the LLMs predicting the previous token are indeed pre-trained in this way, so it is not true that the difference is obvious.
[–] frotaur 2y ago ↗ In the paper it is mentioned that the LLMs predicting the previous token are indeed pre-trained in this way, so it is not true that the difference is obvious.
4 comments
[ 3.9 ms ] story [ 18.1 ms ] thread