4 ms·
Llama2 on Replicate faster than ChatGPT?
- ij23 3y agoRan some testing and discovered llama2 on replicate is faster than chatgpt! Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evaluating_LLMs.ipynb https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua... Are others seeing similar results?
- agnokapathetic 3y agoThe response time you get from a Pay-as-you-Go account on OpenAI is not anything close to what you get with an Enterprise Agreement. If your usage is large enough, talk to your account rep.