5 ms·
Qwen 3 is not slow by any metrics. Which model, inference software and hardware are you running it on? The 30BA3B variant flies on any GPU.
by xfalcox 1y ago
Qwen 3 is not slow by any metrics.
Which model, inference software and hardware are you running it on?
The 30BA3B variant flies on any GPU.