5 ms·A complete Llama2 inference engine that fits in 1356 bytes of x86 assembly27 points by monax 5mo ago