5 ms·
> Meta/Googly/Claudy will say... oh nice, let's download it and run it... You can run it for like <$50/hr. You don't need to be Meta/Googly/Claudy for that. Fo
by YetAnotherNick 1mo ago
> Meta/Googly/Claudy will say... oh nice, let's download it and run it...
You can run it for like <$50/hr. You don't need to be Meta/Googly/Claudy for that. For batch inference it makes sense to run it yourself(high latency, high throughput, predefined workload for few hours or day).