Unlock Massive Context Windows: Positional embeddings are just training wheels (xcancel.com) 1 points by bigwheels 8mo ago ↗ HN
[–] sjkoelle 8mo ago ↗ Would this generate the same completion for 'the cat sat on the' as 'on the cat sat the'?
2 comments
[ 3.4 ms ] story [ 18.0 ms ] thread