guanming0717

6 ms·

1. 1.▲
   by guanming0717 3mo ago

   Yes I did, with other SOTA quant methods like HQQ, AWQ etc. You can find more info in our blog :) https://general-instinct.com/blog/frontier-moe-sub-4-bit
2. 2.▲
   by guanming0717 3mo ago

   Thanks for sharing! I'd love to chat with him. Would you be open to introducing us? :)
3. 3.▲
   Launch HN: General Instinct (YC P26) – Frontier models on edge devices

   63 points by guanming0717 3mo ago|16 comments