5 ms·
Which setup did you use? MLX/GGUF, Quant, Engine (e.g. llama.cpp or MTPLX, etc)? There’s so much variety these days.
by terhechte 1mo ago
Which setup did you use? MLX/GGUF, Quant, Engine (e.g. llama.cpp or MTPLX, etc)? There’s so much variety these days.
- dexterlagan 1mo agoIt was in LMStudio (llama.cpp), Q4 by Unsloth. Applied the recommended defaults published by Unsloth.