6 ms·
671B parameters! Well, it doesn't look like I'll be running that locally.
by AJAlabs 1y ago
671B parameters! Well, it doesn't look like I'll be running that locally.
- amy_petrik 1y agothere is a small community of people that do indeed run this locally. typically on CPU/RAM (lots and lots of RAM), insofar as that's cheaper than GPU(s).