sci-genie

↗ HN profile [ 26.5 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. Context length is such an important aspect in today’s AI race. All major players actively advertise this too. Given how matrix math works, how do people run inference for a transformer when the context length is so long…