5 ms·
You could try running the smaller QAT Gemma 4 models but I doubt they'll be very good for software engineering work.
by alimbada 3mo ago
You could try running the smaller QAT Gemma 4 models but I doubt they'll be very good for software engineering work.
- euroderf 3mo agoThanks for the reply. What I'm getting from numerous HN discussions is that 8GB is a hopeless case (and the money I saved on RAM should be spent on non-local coding assist).