5 ms·

Does this make Meta AI more “open” than OpenAI? Oh, the irony.

by scrollbar 4y ago

axg11 4y ago
They always have been. Meta has made a number of open contributions for the ML/AI community, one of which is PyTorch.
px43 4y ago
Not surprising at all since OpenAI is basically run by Microsoft now.
kirubakaran 4y ago
"Open" in OpenAI is like countries with "Democratic" in their name e.g. Democratic People's Republic of Korea https://petervojtek.github.io/diy/2015/05/19/countries-with-democracy-in-name.html https://petervojtek.github.io/diy/2015/05/19/countries-with-...
mtlmtlmtlmtl 4y ago
Don't worry, I'm sure they have some nefarious plans down the road. They're just being "open" to corner the market first.
- nomilk 4y ago
  > to corner the market first Is Meta's model going to be open source or paid?
  - deleted 4y ago
    [deleted]
  - sanxiyn 4y ago
    The linked paper makes it clear it will be released under a non-commercial license. You will download it gratis (so it won't be paid), but it won't be open source.
    - mtlmtlmtlmtl 4y ago
      So they make a more available alternative, but they maintain control over it, and in turn gain control over the people and companies using it. Similar to what Microsoft did by bundling Windows with PCs[1]. I already have a multitude of ideas on potential nefarious plans based on this, but I'll keep them to myself. [1]: Sure they got a licence payment, but since it was built into the price and non-optional, it was effectively equivalent to free from the customer POV. It effectively became a tax. I have to admit, Gates might not be a genius programmer but he sure knows how to design dark patterns :)
- daenz 4y ago
  My guess is that they've "fingerprinted" the model sufficiently that they can identify content that has been created with it.
  - deleted 4y ago
    [deleted]
  - p1esk 4y ago
    What are you talking about?
    - daenz 4y ago
      It's pretty simple. GPT models are essentially information weapons. People are going to get their hands on them, so might as well give them a model where you can identify content generated with them, so you can know who is using them for nefarious purposes. Like how many printers encode hidden patterns on paper that identify the model of the printer and other information[0] 0. https://www.bbc.com/future/article/20170607-why-printers-add-secret-tracking-dots https://www.bbc.com/future/article/20170607-why-printers-add...
      - p1esk 4y ago
        How can you identify content generated with them?
        daenz 4y ago
        By training a GAN. A trained GAN will be able to accurately guess whether a block of text was produced by this GPT model, some other GPT model, or is authentic.
        dotnet00 4y ago
        If differentiating between real samples and generated ones were as straightforward as "training a GAN", detecting deep fakes would not be as big of a research topic as it is.
TulliusCicero 4y ago
This isn't very open; they're not just letting anyone download it, like you might expect.
deleted 4y ago
[deleted]

Does this make Meta AI more “open” than OpenAI? Oh, the irony.

axg11 4y ago

They always have been. Meta has made a number of open contributions for the ML/AI community, one of which is PyTorch.

px43 4y ago

Not surprising at all since OpenAI is basically run by Microsoft now.

kirubakaran 4y ago

"Open" in OpenAI is like countries with "Democratic" in their name e.g. Democratic People's Republic of Korea https://petervojtek.github.io/diy/2015/05/19/countries-with-democracy-in-name.html https://petervojtek.github.io/diy/2015/05/19/countries-with-...

mtlmtlmtlmtl 4y ago

Don't worry, I'm sure they have some nefarious plans down the road. They're just being "open" to corner the market first.

nomilk 4y ago
> to corner the market first Is Meta's model going to be open source or paid?
- deleted 4y ago
  [deleted]
- sanxiyn 4y ago
  The linked paper makes it clear it will be released under a non-commercial license. You will download it gratis (so it won't be paid), but it won't be open source.
  - mtlmtlmtlmtl 4y ago
    So they make a more available alternative, but they maintain control over it, and in turn gain control over the people and companies using it. Similar to what Microsoft did by bundling Windows with PCs[1]. I already have a multitude of ideas on potential nefarious plans based on this, but I'll keep them to myself. [1]: Sure they got a licence payment, but since it was built into the price and non-optional, it was effectively equivalent to free from the customer POV. It effectively became a tax. I have to admit, Gates might not be a genius programmer but he sure knows how to design dark patterns :)
daenz 4y ago
My guess is that they've "fingerprinted" the model sufficiently that they can identify content that has been created with it.
- deleted 4y ago
  [deleted]
- p1esk 4y ago
  What are you talking about?
  - daenz 4y ago
    It's pretty simple. GPT models are essentially information weapons. People are going to get their hands on them, so might as well give them a model where you can identify content generated with them, so you can know who is using them for nefarious purposes. Like how many printers encode hidden patterns on paper that identify the model of the printer and other information[0] 0. https://www.bbc.com/future/article/20170607-why-printers-add-secret-tracking-dots https://www.bbc.com/future/article/20170607-why-printers-add...
    - p1esk 4y ago
      How can you identify content generated with them?
      - daenz 4y ago
        By training a GAN. A trained GAN will be able to accurately guess whether a block of text was produced by this GPT model, some other GPT model, or is authentic.
        dotnet00 4y ago
        If differentiating between real samples and generated ones were as straightforward as "training a GAN", detecting deep fakes would not be as big of a research topic as it is.

TulliusCicero 4y ago

This isn't very open; they're not just letting anyone download it, like you might expect.

deleted 4y ago

[deleted]