6 ms·
Seems much more likely the cost will go down 99%. With open source models and architectural innovations, something like Claude will run on a local machine for f
by crystaln 8mo ago
Seems much more likely the cost will go down 99%. With open source models and architectural innovations, something like Claude will run on a local machine for free.
- walterbell 8mo agoHow much RAM and SSD will be needed by future local inference, to be competitive with present cloud inference?