5 ms·
What are the minimal hardware requirements to run a reasonable good local model for real SWE work these days? And have a reasonable inference speed? Seems like
by acb12 3mo ago
What are the minimal hardware requirements to run a reasonable good local model for real SWE work these days? And have a reasonable inference speed? Seems like the requirement are pretty high and the inference speed is not ideal.