7 ms·
running it on my M4 @ 90tps, takes 18GB of RAM.
by jonrosner 9mo ago
running it on my M4 @ 90tps, takes 18GB of RAM.
- pylotlight 9mo agoM2 Max @ 17tps btw
- Tepix 9mo agoIf it uses 18GB of RAM, you're not using the official model (released in BF16 and FP8), but a quantization of unknown quality. If you write "M4", you mean M4 and not M4 Pro or M4 Max?