5 ms·
One further: what’s the best performing model one could reasonably self-host, either locally on a single 4090 or say remotely on a single A100?
by skhm 4y ago
One further: what’s the best performing model one could reasonably self-host, either locally on a single 4090 or say remotely on a single A100?