7 ms·

> We should crack down on industrial-scale distillation operations. Also Anthropic: AI firm Anthropic agrees to pay authors $1.5bn to settle piracy lawsuit h

by fuddle 2mo ago

> We should crack down on industrial-scale distillation operations. Also Anthropic: AI firm Anthropic agrees to pay authors $1.5bn to settle piracy lawsuit https://www.bbc.com/news/articles/c5y4jpg922qo https://www.bbc.com/news/articles/c5y4jpg922qo

tkamado 2mo ago
but Dario is the good guy, distillation when done by Dario should be called innovation /s
burningion 2mo ago
I wish this were higher up! They pirated my work and now they want government protection from other people doing the same.
jscott817 2mo ago
I generally disagree with the claim that distilling a model is equivalent to training on freely available internet content – mostly due to investment required to turn it into a model – but piracy is another story. Pretty inexcusable.
- Ekaros 2mo ago
  If they paid for tokens say via subscriptions. Wouldn't that just be same as acquiring books and using them as "fair use" to train? I really see no difference.
  - nicce 2mo ago
    They did not need to destroy the models they got with pirated content. Would have been more fine if they would have needed to buy the books afterwards and train based on then, again.
  - buzzin__ 2mo ago
    "And when their eloquence escapes me Their logic ties me up and rapes me" Police, 1980
- antonvs 2mo ago
  > I generally disagree with the claim that distilling a model is equivalent to training on freely available internet content – mostly due to investment required to turn it into a model The frontier labs all give free access to their models. Why does “investment” change anything? Anyone who’s ever produced any content, free or otherwise, has invested in doing so. The only plausible issue I see is that if distillation is being done by creating many free accounts to work around limits on free accounts, that’s a bit… impolite? But if they really wanted to avoid that, they could eliminate free accounts, and require users to sign a real contract governing what they can do with the model. Of course they don’t want to do that, so they’re stuck in the same world as the rest of us, and they don’t have any real basis to complain about it without being hypocritical.

by fuddle 2mo ago

tkamado 2mo ago

but Dario is the good guy, distillation when done by Dario should be called innovation /s

burningion 2mo ago

I wish this were higher up! They pirated my work and now they want government protection from other people doing the same.

jscott817 2mo ago

I generally disagree with the claim that distilling a model is equivalent to training on freely available internet content – mostly due to investment required to turn it into a model – but piracy is another story. Pretty inexcusable.

Ekaros 2mo ago
If they paid for tokens say via subscriptions. Wouldn't that just be same as acquiring books and using them as "fair use" to train? I really see no difference.
- nicce 2mo ago
  They did not need to destroy the models they got with pirated content. Would have been more fine if they would have needed to buy the books afterwards and train based on then, again.
- buzzin__ 2mo ago
  "And when their eloquence escapes me Their logic ties me up and rapes me" Police, 1980
antonvs 2mo ago
> I generally disagree with the claim that distilling a model is equivalent to training on freely available internet content – mostly due to investment required to turn it into a model The frontier labs all give free access to their models. Why does “investment” change anything? Anyone who’s ever produced any content, free or otherwise, has invested in doing so. The only plausible issue I see is that if distillation is being done by creating many free accounts to work around limits on free accounts, that’s a bit… impolite? But if they really wanted to avoid that, they could eliminate free accounts, and require users to sign a real contract governing what they can do with the model. Of course they don’t want to do that, so they’re stuck in the same world as the rest of us, and they don’t have any real basis to complain about it without being hypocritical.