joliu

5 ms·

1. 1.▲
   by joliu 1y ago

   It does run inference, but on the batch of tokens that were drafted, akin to the prefill phase. So your draft model can decode N new tokens, then the real model does one inference pass to score the N new drafted tokens. Prefill is computati
2. 2.▲
   by joliu 4y ago

   Shape Rotator. That is the meme.
3. 3.▲
   by joliu 6y ago

   Doesn't a DSLR work by moving the mirror out of the way of the sensor when taking an image?
4. 4.▲
   by joliu 6y ago

   That may be true but as the popularity of Netflix exclusive content grows so does Netflix's ability to display ads without shedding as much of its user base.
5. 5.▲
   by joliu 9y ago

   Ruby's fastest time for pidigits was 3.14, haha.