9 ms·
I've been using Qwen3.6 models locally for a couple of weeks. Both the A3B moe and the dense variant. The moe works well in Librechat combined with my local sea
by Roark66 1mo ago
I've been using Qwen3.6 models locally for a couple of weeks. Both the A3B moe and the dense variant. The moe works well in Librechat combined with my local search/Web retrieval system. All components use open source projects such as SearXNG, Crawl4AI, MetaMCP, Jina rerank, but all needed quite a bit of coding to work nicely together.
I get 140 tok/s on short prompts on an rtx3090 on the qwen3.6 moe which makes is easily 4x the speed of Chatgpt or Claude doing Web research.
But it is a much simpler model. It is only good for simple queries, usually I search for cheapest product in stock in my country available online and stuff like that.
I use the dense model for planning and such, but on its own it is much inferior to for example opus. It needs careful pipelines that check facts and such and in such harness it can be used for mamy tasks.