9 ms·

Hallucinating is the wrong word here. If the prompt explicitly asks it to "simulate" something then it's just following directions. Hallucinating it would be i

Hallucinating is the wrong word here. If the prompt explicitly asks it to "simulate" something then it's just following directions. Hallucinating it would be if it came up with the concept all by itself. Like I asked where I could see the latest Avatar film and it said "easy, just go onto ftp.disney.com and download it".

bigtones 3y ago
impersonating might be more accurate...
- KyeRussell 3y ago
  Impersonating feels loaded. Simulating is fine.
- deleted 3y ago
  [deleted]
bartislartfast 3y ago
How far away are we from an AI which can hallucinate and simulate. The year is 2026 "hey, how can I watch 'avatar 3 - tokyo drift' today? it's not out yet." "easy, just go onto ftp.disney.com and download it". "really?? can you do it for me?" "yeah here it is" suspiciously fast response arrives, with a video which is a movie about blue aliens that gpt6 has just asked midjourney 8 to create for it.
- naiv 3y ago
  This will be Hollywood's and Netflix's biggest challenge. In a not so distant future you will create your own movies. Or even better: There will be models teached on a show you really liked but which was cancelled and you will be able to continue it to eternity.
  - bartislartfast 3y ago
    we're only a few years away from getting season 2 of firefly, as it would have looked in 2004
    - naiv 3y ago
      I was thinking about Firefly and https://en.wikipedia.org/wiki/The_Inside_(TV_series) https://en.wikipedia.org/wiki/The_Inside_(TV_series) :D
      - bartislartfast 3y ago
        I'm sure we're not the only ones. Probably half the AI industry wants to be able to do that
      - atonse 3y ago
        Glad to know there will be enough people trying to create more firefly episodes!
    - turtleyacht 3y ago
      Thank-you for that. Fans could share prompts as episodes. Wonder how canon would be established, or if it's just throughlines in a wonderful multiverse, remixed to infinity. You can't take the sky from me~
      - bartislartfast 3y ago
        no more than fan-fiction, it would be a popularity contest. "Firefly season 2 by rustyBones447 is the best one"
        deleted 3y ago
        [deleted]
  - _the_inflator 3y ago
    I slightly disagree here. Not really challenges, but business models. There is no free lunch so to say. Maybe there will be highly personalized subscriptions that allow for hyperparameter tuning in this way. I doubt this is something Netflix fears, it is something they gonna embrace. Computation of such movies won't be cheap.
- rvnx 3y ago
  It will not with the current way it goes, because AI models are artificially biased to not offend intellectual property owners and to protect powerful people or influential lobbies. https://i.ibb.co/XLFGdWp/DALL-E-2023-04-05-12-55-36-Mickey-Mouse.png https://i.ibb.co/XLFGdWp/DALL-E-2023-04-05-12-55-36-Mickey-M... Mickey Mouse according to OpenAI is just a symptom, but the root of the issue is very deep if the people preparing the dataset intentionally decide to exclude examples due to commercial or political pressure.
  - bartislartfast 3y ago
    Maybe OpenAI doesn't get it, but Midjourney has no problems showing me Mickey Mouse https://preview.redd.it/n6wdyhyz9dra1.png?width=960&crop=smart&auto=webp&v=enabled&s=9f930e6882d00a6b09859c689282919447cf4d34 https://preview.redd.it/n6wdyhyz9dra1.png?width=960&crop=sma... https://preview.redd.it/9djj6tdflu3a1.png?width=1080&crop=smart&auto=webp&v=enabled&s=63c4c0a18e4b01dfe36dd48c3a23fb6ccdc9f948 https://preview.redd.it/9djj6tdflu3a1.png?width=1080&crop=sm... https://www.reddit.com/r/midjourney/search/?q=mickey%20mouse&restrict_sr=1&sr_nsfw= https://www.reddit.com/r/midjourney/search/?q=mickey%20mouse... And if we've learned anything about AI in the last 6 months we've learned: 1) AI is probably trained on data obtained without the creators permission 2) AI responses are very hard to control, and easily jailbroken
    - wolletd 3y ago
      And there are also already copyright holders filing lawsuits against AI image generators for exactly that: https://www.theverge.com/2023/2/6/23587393/ai-art-copyright-lawsuit-getty-images-stable-diffusion https://www.theverge.com/2023/2/6/23587393/ai-art-copyright-...
      - withinboredom 3y ago
        Since AI can’t hold copyright, it can’t make money, thus what, exactly, are the damages?
        3y ago
- computershit 3y ago
  > The year is 2026 > that gpt6 has just asked midjourney 8 at the current rate gpt16 and midjourney --v 20 are more likely
mhh__ 3y ago
The "can you imagine a world without lawyers!?" answer to how movies should be... I'll pay, just gimme a file to download
31337Logic 3y ago
And why would your example be considered a hallucination, then? The truth is, we have no need for the notion as it applies to AI. It's just a catchy term that sounds great in the media. Nothing the algorithm spits out is a hallucination (or else ALL of it is) because, quite literally, It's all the same uncontrollable output. It'd be as weird as saying your autocorrect feature "hallucinated" any time it presented the "wrong" word to you. (As if it's of clear mind the other times?!)
BeefWellington 3y ago
"Hallucinating" seems to have become the marketing term for "it sometimes gets things very wrong and makes things up."
- bpodgursky 3y ago
  It seems like a very good word for "extremely plausible and life-like misperception of reality".
krsdcbl 3y ago
I think the distinction is utterly useless in such a use case and ultimately just expresses our understanding or interpretation of the outcome. And trying to categorize it's output in those terms is highly misleading regarding how it works. We speak of "hallucination" when GPT provides completions that are not connected to any facts it was "provided with" in either training data or prompts, but ultimately factuality makes no difference to GPT. It ALWAYS just "simulates" text, that's what it does. If you'd want to use these words to describe factual accuracy, or to express if GPT "performs" an action, as opposed to "faking" a result, you have to bear in mind either of these qualifications are nothing but a human interpretation of the completion. It being "correct" more often than not with the content of it's simulation is just a logical, but ultimately accidental consequence of being so well fitted to simulate the structure of data it trained itself on. And a "halucination" is nothing but this simulation deviating from the context you provided, that fundamentally was simulated by the same rules that produced any other content which didn't deviate.

bigtones 3y ago

impersonating might be more accurate...

KyeRussell 3y ago
Impersonating feels loaded. Simulating is fine.
deleted 3y ago
[deleted]

bartislartfast 3y ago

How far away are we from an AI which can hallucinate and simulate. The year is 2026 "hey, how can I watch 'avatar 3 - tokyo drift' today? it's not out yet." "easy, just go onto ftp.disney.com and download it". "really?? can you do it for me?" "yeah here it is" suspiciously fast response arrives, with a video which is a movie about blue aliens that gpt6 has just asked midjourney 8 to create for it.

naiv 3y ago
This will be Hollywood's and Netflix's biggest challenge. In a not so distant future you will create your own movies. Or even better: There will be models teached on a show you really liked but which was cancelled and you will be able to continue it to eternity.
- bartislartfast 3y ago
  we're only a few years away from getting season 2 of firefly, as it would have looked in 2004
  - naiv 3y ago
    I was thinking about Firefly and https://en.wikipedia.org/wiki/The_Inside_(TV_series) https://en.wikipedia.org/wiki/The_Inside_(TV_series) :D
    - bartislartfast 3y ago
      I'm sure we're not the only ones. Probably half the AI industry wants to be able to do that
    - atonse 3y ago
      Glad to know there will be enough people trying to create more firefly episodes!
  - turtleyacht 3y ago
    Thank-you for that. Fans could share prompts as episodes. Wonder how canon would be established, or if it's just throughlines in a wonderful multiverse, remixed to infinity. You can't take the sky from me~
    - bartislartfast 3y ago
      no more than fan-fiction, it would be a popularity contest. "Firefly season 2 by rustyBones447 is the best one"
      - deleted 3y ago
        [deleted]
- _the_inflator 3y ago
  I slightly disagree here. Not really challenges, but business models. There is no free lunch so to say. Maybe there will be highly personalized subscriptions that allow for hyperparameter tuning in this way. I doubt this is something Netflix fears, it is something they gonna embrace. Computation of such movies won't be cheap.
rvnx 3y ago
It will not with the current way it goes, because AI models are artificially biased to not offend intellectual property owners and to protect powerful people or influential lobbies. https://i.ibb.co/XLFGdWp/DALL-E-2023-04-05-12-55-36-Mickey-Mouse.png https://i.ibb.co/XLFGdWp/DALL-E-2023-04-05-12-55-36-Mickey-M... Mickey Mouse according to OpenAI is just a symptom, but the root of the issue is very deep if the people preparing the dataset intentionally decide to exclude examples due to commercial or political pressure.
- bartislartfast 3y ago
  Maybe OpenAI doesn't get it, but Midjourney has no problems showing me Mickey Mouse https://preview.redd.it/n6wdyhyz9dra1.png?width=960&crop=smart&auto=webp&v=enabled&s=9f930e6882d00a6b09859c689282919447cf4d34 https://preview.redd.it/n6wdyhyz9dra1.png?width=960&crop=sma... https://preview.redd.it/9djj6tdflu3a1.png?width=1080&crop=smart&auto=webp&v=enabled&s=63c4c0a18e4b01dfe36dd48c3a23fb6ccdc9f948 https://preview.redd.it/9djj6tdflu3a1.png?width=1080&crop=sm... https://www.reddit.com/r/midjourney/search/?q=mickey%20mouse&restrict_sr=1&sr_nsfw= https://www.reddit.com/r/midjourney/search/?q=mickey%20mouse... And if we've learned anything about AI in the last 6 months we've learned: 1) AI is probably trained on data obtained without the creators permission 2) AI responses are very hard to control, and easily jailbroken
  - wolletd 3y ago
    And there are also already copyright holders filing lawsuits against AI image generators for exactly that: https://www.theverge.com/2023/2/6/23587393/ai-art-copyright-lawsuit-getty-images-stable-diffusion https://www.theverge.com/2023/2/6/23587393/ai-art-copyright-...
    - withinboredom 3y ago
      Since AI can’t hold copyright, it can’t make money, thus what, exactly, are the damages?
      - 3y ago
computershit 3y ago
> The year is 2026 > that gpt6 has just asked midjourney 8 at the current rate gpt16 and midjourney --v 20 are more likely

mhh__ 3y ago

The "can you imagine a world without lawyers!?" answer to how movies should be... I'll pay, just gimme a file to download

31337Logic 3y ago

And why would your example be considered a hallucination, then? The truth is, we have no need for the notion as it applies to AI. It's just a catchy term that sounds great in the media. Nothing the algorithm spits out is a hallucination (or else ALL of it is) because, quite literally, It's all the same uncontrollable output. It'd be as weird as saying your autocorrect feature "hallucinated" any time it presented the "wrong" word to you. (As if it's of clear mind the other times?!)

BeefWellington 3y ago

"Hallucinating" seems to have become the marketing term for "it sometimes gets things very wrong and makes things up."

bpodgursky 3y ago
It seems like a very good word for "extremely plausible and life-like misperception of reality".

krsdcbl 3y ago

I think the distinction is utterly useless in such a use case and ultimately just expresses our understanding or interpretation of the outcome. And trying to categorize it's output in those terms is highly misleading regarding how it works. We speak of "hallucination" when GPT provides completions that are not connected to any facts it was "provided with" in either training data or prompts, but ultimately factuality makes no difference to GPT. It ALWAYS just "simulates" text, that's what it does. If you'd want to use these words to describe factual accuracy, or to express if GPT "performs" an action, as opposed to "faking" a result, you have to bear in mind either of these qualifications are nothing but a human interpretation of the completion. It being "correct" more often than not with the content of it's simulation is just a logical, but ultimately accidental consequence of being so well fitted to simulate the structure of data it trained itself on. And a "halucination" is nothing but this simulation deviating from the context you provided, that fundamentally was simulated by the same rules that produced any other content which didn't deviate.