[–] ij23 3y ago ↗ Ran some testing and discovered llama2 on replicate is faster than chatgpt!Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...Are others seeing similar results?
[–] agnokapathetic 3y ago ↗ The response time you get from a Pay-as-you-Go account on OpenAI is not anything close to what you get with an Enterprise Agreement. If your usage is large enough, talk to your account rep.
2 comments
[ 3.7 ms ] story [ 11.1 ms ] threadCode - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...
Are others seeing similar results?