Faster token generation at 1/10th the cost per token seems like a great indication, unless they're just fleecing us with -003
This falls in the category of circumstantial, possibly just coincidental evidence of Chat being a "compressed" model (quantized, pruned, or distilled): the hard prompt from this paper: Compress, Then Prompt: Improving…
Faster token generation at 1/10th the cost per token seems like a great indication, unless they're just fleecing us with -003
This falls in the category of circumstantial, possibly just coincidental evidence of Chat being a "compressed" model (quantized, pruned, or distilled): the hard prompt from this paper: Compress, Then Prompt: Improving…