7 ms·
Get a Strix Point or Strix Halo with 128GB DDR5 RAM and you can run gpt-oss 120B at 10-20+ TPS.
by compumetrika 1y ago
Get a Strix Point or Strix Halo with 128GB DDR5 RAM and you can run gpt-oss 120B at 10-20+ TPS.
- magicalhippo 1y agoGood point, though at the price of a 5090 I'm more tempted to get the 5090, as I do still game a bit as well.
- deleted 1y ago[deleted]