6 ms·
I've been playing with Llama 3.2-3B this weekend and, while I haven't spent enough time with it to figure out the limitations, it's definitely good enough to be
by VBprogrammer 1y ago
I've been playing with Llama 3.2-3B this weekend and, while I haven't spent enough time with it to figure out the limitations, it's definitely good enough to be useful. That's running at "as fast as I can read" on a £100 Intel Arc GPU. I'm tempted to buy a Arc770 (£250ish) to see if I can run the OpenAI open weights models...
I think it's reasonably likely that these massive investments turn to dust when they get squeezed by the commoditization of LLMs.