14 ms·
> Local LLMs do best on big GPUs, which aren’t an option on Macs. For processing speed, Ms are fast but I agree not anywhere near a top Nvdia chip. For memory
by daniel-thompson 3y ago
> Local LLMs do best on big GPUs, which aren’t an option on Macs.
For processing speed, Ms are fast but I agree not anywhere near a top Nvdia chip.
For memory size, the memory on an M chip can be used as graphics memory, so a person could get an M2 today with 128GB of graphics memory for ~ $5k. Not bad considering an Nvidia chip approaching that memory size is several times that much.
- deleted 3y ago[deleted]