5 ms·
actually, yes they do have support for Llama2 70B, you need 39GB of ram, compared to 130GB that it originally takes.
by torrmal 3y ago
actually, yes they do have support for Llama2 70B, you need 39GB of ram, compared to 130GB that it originally takes.