5 ms·
As an opesource AI researcher with a lot of models and datasets on huggingface I am very appreciative of these types of project but we are ignoring the elephant
by nisten 3mo ago
As an opesource AI researcher with a lot of models and datasets on huggingface I am very appreciative of these types of project but we are ignoring the elephant in the room here ( or lack of )
the swiss have no gpus
- kennywinker 3mo agoHow is this a real problem? Genuine question, because i don’t really understand the urgency of everyone buying up ram and gpus as prices for those skyrocket. I can run the 8B version of this swiss-ai model on a ten year old GPU. For the larger one, $2000 consumer hardware can run it fine. Beyond that, there are plenty of places where time on a GPU can be rented, and if the model is good, there will be hardware to run it.
- pu_pe 3mo agoYou can run it, but you can't train it. While this type of toy model could actually be trained in Swiss equipment, a state-of-the-art LLM probably could not. My charitable reading of GP's point is that the bottleneck for true compute sovereignty is the chips, not the models.
- markhahn 3mo agowhy do you say the Swiss have no gpus?
- T-A 3mo agothe Apertus model was trained on the Alps supercomputer, operational at CSCS since September 2024, a data center of over 10'000 top-of-the-line NVIDIA Grace-Hopper chips https://log.alets.ch/110/ https://log.alets.ch/110/
- khalic 3mo agoDo some research before posting that kind of stuff