6 ms·
So, unlike what leaders of western labs labs would like you to believe (that Kimi is just the result of distillation attacks), they are introducing new and nove
by constantlm 2mo ago
So, unlike what leaders of western labs labs would like you to believe (that Kimi is just the result of distillation attacks), they are introducing new and novel approaches.
- boomskats 2mo agoNo! It's just not fair!! What about our financial bubble!
- hlynurd 2mo ago"attack"
- nostromo 2mo agoEven if they are distilling, I don't particularly care. Anthropic and others have been distilling copyrighted material by to build these models, largely without permission.
- wnsdy95 2mo ago[flagged]
- mensetmanusman 2mo agoIf you redefine the technical world distilling to mean training on text, you are correct.
- deleted 2mo ago[deleted]
- brookst 2mo agoWe’re all distillers now.
- xdennis 2mo agoPeople don't remember now, but in the old HN comments like "this is so true honestly" would have been downvoted. If a comment just agrees with the parent, people would have said that's what the upvote button is for. Adding a "I agree" comment is just noise.
- protocolture 2mo agoThis is so true honestly.
- xdennis 2mo agoAlso Reddit-style humorous replies were frowned upon because they ruin serious discussion and encourage karma chasing as opposed to providing valuable insight.
- ThePinion 2mo agoWith all the botting and slop going on right now on HN I'd say these once annoyances are now quite arbitrary. I'm sure it bothered you and maybe one other person at this point in time, but it's pretty damn easy to scroll past it compared to actively reading comments that you half way through realize are just LLMs.
- newswasboring 2mo agoTo be honest, comment like yours were also frowned upon haha. If you think something is bad for discussion, downvote. If you think something is objectionable, flag it. And now I have made a faux pas by explaining the rule to you rather than just downvoting and moving on. Its turtles all the way down today.
- mejutoco 2mo agoThis is why on Slashdot you could vote on insightful, humorous, etc. Something neither reddit, not hn have caugh on yet. Digg could have done it.
- Bluestein 2mo ago
- ransom1538 2mo agoExactly,let Anthropic get back to training on the New York times.
- FinchNova12 2mo ago"Kimi is largely a byproduct of distillation" and "Kimi is introducing new and novel approaches" are not mutually exclusive, and I'm not sure it's clear from the paper how much of the improvement comes from the new approaches. So I wouldn't take the new approaches to be much evidence about whether the distillation attacks occurred.
- anon373839 2mo ago> distillation attacks Like the distillation “attacks” Anthropic conducted against literally millions and millions of different creators?
- mensetmanusman 2mo agoScanning google is an ‘attack’
- waterTanuki 2mo agoReading Claude's outputs is an 'attack'
- boomskats 2mo agoOr against all those old books that they ingested and then literally destroyed
- nl 2mo agoEven Anthropic hasn't claimed "Kimi is largely a byproduct of distillation" There's been some distillation. Just like how Elon said in court they distill to make Grok.
- FinchNova12 2mo agoI thought there is discussion circulating around whether the main reason Kimi is impressive is due to distillation. Though possibly if this occurred, this was just one component of their training pipeline and not a majority
- ozgung 2mo agoMoreover, Distillation is a misused term here. Distillation means training a smaller student model using a larger teacher model to completely mimic its behavior. As in you take a base model and create its smaller “turbo” version. Like distillation in Chemistry it means it’s %100 purified version of its teacher.