4 ms·
Qwen2.5-Max: Exploring the intelligence of large-scale MoE model
- simonw 2y agoThis appears to be Qwen's new best model, API only for the moment, which they say is better than DeepSeek v3.
- rochoa 2y agoIt is available at https://chat.qwenlm.ai/ https://chat.qwenlm.ai/, under the model selector.
- ecshafer 2y agoA Chinese company announcing this on Spring Festival eve, that is very surprising. The deep seek announcement must have put a fire under them. I am surprised anything is being done right now in these Chinese tech companies.
- lostmsu 2y agoIt's like when Gemini topped Chatbot Arena Leaderboard, and OpenAI released a model next day.
- lousken 2y agois gemini really better than e.g. claude 3.5?
- famouswaffles 2y agoMostly, but not for coding. Also the arena is pretty much a vibes benchmark. Don't take it too seriously. Livebench is a better indicator
- jaggs 2y agoGemini is actually pretty useless because of its rate limits.
- rfoo 2y agoWell, DeepSeek engineers are (desperately) fire-fighting as they don't have nearly as much capacity as needed. Competitors either already rushed release or decided to do an hush release of whatever they had in the pipeline. Sounds like everyone is working L
- nostradumbasp 2y agoThey are being attacked as well. https://apnews.com/article/deepseek-ai-artificial-intelligence-be414acadbf35070d7645fe9fbd8f464 https://apnews.com/article/deepseek-ai-artificial-intelligen...
- bigcat12345678 2y agoParty goes on
- deleted 2y ago[deleted]
- GaggiX 2y agoNow they need to finetune it like R1 and o1 and it will be competitive with SOTA models.
- BhavdeepSethi 2y agoHuggingFace demo: https://huggingface.co/spaces/Qwen/Qwen2.5-Max-Demo https://huggingface.co/spaces/Qwen/Qwen2.5-Max-Demo Source: https://x.com/Alibaba_Qwen/status/1884263157574820053 https://x.com/Alibaba_Qwen/status/1884263157574820053
- alecco 2y agoNo weights, no proof.
- jondwillis 2y agoThe significance of _all_ of these releases at once is not lost on me. But the reason for it is lost on me. Is there some convention? Is this political? Business strategy?
- logicchains 2y agoToday is the last day before the Chinese New Year.
- voxgen 2y agoMy thoughts go out to the poor engineers who got put on call because someone scheduled a product release on the day before the biggest holiday of their year.
- halJordan 2y agoSometimes a cigar is just a cigar
- k__ 2y agoAlibaba probably doesn't want DeepSeek to get all the fame.
- a_wild_dandan 2y ago> We evaluate Qwen2.5-Max alongside leading models > [...] we are unable to access the proprietary models such as GPT-4o and Claude-3.5-Sonnet. Therefore, we evaluate Qwen2.5-Max against DeepSeek V3 "We'll compare our proprietary model to other proprietary models. Except when we don't. Then we'll compare to non-proprietary models."
- Jackson__ 2y ago>Many critical details regarding this scaling process were only disclosed with the recent release of DeepSeek V3 And so they decide to not disclose their own training information just after they told everyone how useful it was to get Deepseeks? Honestly can't say I care about "nearly as good as o1" when its a closed API with no additional info.
- voxgen 2y agoIt's not even "nearly as good as o1". They only compared to the older 4o. You can safely assume Qwen2.5-Max will score worse than all of the recent reasoning models (o1, DeepSeek-R1, Gemini 2.0 Flash Thinking). It'll probably become a very strong model if/when they apply RL training for reasoning. However, all the successful recipes for this are closed source, so it may take some time. They could do SFT based on another model's reasoning chains in the meantime, though the DeepSeek-R1 technical report noted that it's not as good as RL training.
- kragen 2y agoI thought there were three DeepSeek items on the HN front page, but this turned out to be a fourth one, because it's the Qwen team saying they have a secret version of Qwen that's actually better than DeepSeek-V3. I don't remember the last time 20% of the HN front page was about the same thing. Then again, nobody remembers the last time a company's market cap fell by 569 billion dollars like NVIDIA did yesterday.
- zone411 2y agoI just ran my NYT Connections benchmark on it: 18.6, up from 14.8 for Qwen 2.5 72B. I'll run my other benchmarks later. https://github.com/lechmazur/nyt-connections/ https://github.com/lechmazur/nyt-connections/
- Havoc 2y agoKinda ambivalent about MoE in cloud. Where it could really shine though is in desktop class gear. Memory is starting to get fast enough where we might see MoEs being not painfully slow soon for large-ish models.
- mohsen1 2y agoThis is not the reasoning model. If they beat Deepseek V3 in benchmarks I think a 'reasoning' model would beat o1 Pro