4 ms·

I have a Windows PC with a GTX 5070 (12GB) any chance to run it?

• simonw 1y ago
  I expect that will run Qwen 3 8B quite happily, and I've found that to be a surprisingly capable model for its size.
• UK-Al05 1y ago
  The 30B one requires 20 GB of memory for me. But some of the lower parameters one should be ok
  • avetiszakharyan 1y ago
    For me it was peaking at 35GB even when using