7 ms·
pi is a fantastic harness! they are a good default in the same way llama.cpp is. it works with everything and that is the point. i was steering chad in the op
by nasutton12 5d ago
pi is a fantastic harness! they are a good default in the same way llama.cpp is. it works with everything and that is the point.
i was steering chad in the opposite direction. one model & one set of silicon -> taken to the max. swap out your CHAD_MODEL and it still runs, you just leave the drafter and the kernels behind.
- Terretta 3d agoLove the idea… Except the "one model" is too small for a 64GB Mac much less 128GB, sad since the Q3 is proven less competent. Offering a Q boost (with no leave behinds) on first run would be a bump worth some vibe coding while.