hhuytho

6 ms·

1. 1.▲
   by hhuytho 5mo ago

   Yes, a few interesting observations: - Instead of the conventional wisdom for fusion: "fuse early, fuse aggressively", the search does the opposite for Q. It fuses K's RMSNorm at K-cache-write time (one norm. for the whole K
2. 2.▲
   Show HN: Bonsai 1.7B ternary model at 442T/s on M4 Max(agents2agents.ai)

   13 points by hhuytho 5mo ago|3 comments