5 ms·
Why would an open local model use less resources?
by lacunary 24d ago
Why would an open local model use less resources?
- tonis2 24d agoYou don't usually cool local GPU's with community water and you don't need to cut down trees to create room for data-center. I would love that local AI's, would be good enough for my coding demands, but so far It's not there yet for me.
- simonw 24d agoI expect the energy usage of a thousand people all running their own local models is significantly less efficient than those same people sharing a model hosted in a data center.