6 ms·
Look into deepseek's papers. They have done some stuff recently about improving inference and it seems to be how they can sell tokens so cheap.
by jboss10 3mo ago
Look into deepseek's papers. They have done some stuff recently about improving inference and it seems to be how they can sell tokens so cheap.