[flagged]
Some harness (cc) injects system messages in the middle, this kills the cache as the model provider moves the system to the top and concatenate them together. Use homemade proxy, you will get same 99% hot rate with even…
[flagged]
[flagged]
[flagged]
[flagged]
Some harness (cc) injects system messages in the middle, this kills the cache as the model provider moves the system to the top and concatenate them together. Use homemade proxy, you will get same 99% hot rate with even…