hasanar1f

↗ HN profile [ 17.8 ms ] full profile

Karma: 0
Created: ()
Submissions: 0

Is LMCache entirely lossless? Cuz, the kv cache streamig in the Cachegen paper was not lossless. Or is there any way to control the loss in LMCache?

1y ago · view thread · ↗