Yes, I didn't even say anything about how suspicious the rest of it is because maybe I really was missing something and the author would point it out here. There are numerous red flags. At best it is someone trying to…
Am I missing something? As far as I can see this patch does nothing except add new options that replicate the functionality of the existing --cache-type-k and --cache-type-v options. Using `--flash-attn --cache-type-k…
Yes, I didn't even say anything about how suspicious the rest of it is because maybe I really was missing something and the author would point it out here. There are numerous red flags. At best it is someone trying to…
Am I missing something? As far as I can see this patch does nothing except add new options that replicate the functionality of the existing --cache-type-k and --cache-type-v options. Using `--flash-attn --cache-type-k…