7 ms·
I am not familiar with Replicate, but based on their website, they charge per GPU type. I didn't see the GPU type set in the example. Is it baked in as part of
by zyl1n 3y ago
I am not familiar with Replicate, but based on their website, they charge per GPU type. I didn't see the GPU type set in the example. Is it baked in as part of the "a16z-infra/llama13b-v2-chat" model?
- DougBTX 3y agoThere's info about that here: https://replicate.com/a16z-infra/llama13b-v2-chat https://replicate.com/a16z-infra/llama13b-v2-chat > Run time and cost > Predictions run on Nvidia A100 (40GB) GPU hardware. Predictions typically complete within 9 seconds.