6 ms·
I might be missing something but it looks to me that actually running this "open" model requires special hardware only accessible with a cloud subscription with
by rnosov 3y ago
I might be missing something but it looks to me that actually running this "open" model requires special hardware only accessible with a cloud subscription with 60 000 USD / week minimum spend[1]. Can anyone confirm if you can run it on your own hardware? If software is open but hardware is locked I don't see the point.
[1] https://www.hpcwire.com/2021/09/16/cerebras-wafer-scale-engine-ai-system-is-now-available-in-the-cloud/#:~:text=With%20a%20weekly%20minimum%20buy,the%20entire%20CS%2D2%20system https://www.hpcwire.com/2021/09/16/cerebras-wafer-scale-engi....
EDIT: Ok, looks like I've missed the hugging face repo. The language they use is a bit confusing.
- bubblethink 3y agoYou can run inference on GPUs. These are just models and weights.
- simonw 3y agoThe PyTorch model files are already available to download from Hugging Face - the largest one looks to be 52GB. They should run on any hardware that can run regular PyTorch models.