How LLMs Know When to Stop Talking? (louisbouchard.ai)

1 points by Capstanlqc 1y ago ↗ HN

1 comment

[ 3.0 ms ] story [ 36.7 ms ] thread

favaloralo 1y ago ↗

That's easy - they learn to predict the "End of response" token.