5 ms·
Probably less than the cost of an LLM doing exactly the same thing?
by apsdsm 8mo ago
Probably less than the cost of an LLM doing exactly the same thing?
- BoredomIsFun 8mo agoNot sure about that - a local 12b-32b LLM consumes miniscule amount of energy compared to gaming on the same hardware.