5 ms·
Which GPU card can I buy to run this model? Can it run on commercial RTX3090 or does it need a custom GPU?
by sharbloop 2y ago
Which GPU card can I buy to run this model? Can it run on commercial RTX3090 or does it need a custom GPU?
- Havoc 2y ago3090 or 4090 will be able to run quantized 22B models. Though realistically for code completion smaller models will be better due to speed
- TechDebtDevin 2y agoEasy..