5 ms·

Not saying it's not gonna get better... But at this stage, "convincing" GPT-4 isn't an achievement but more of a built-in quirk that's not very well calibrated.

by erur 3y ago

Not saying it's not gonna get better... But at this stage, "convincing" GPT-4 isn't an achievement but more of a built-in quirk that's not very well calibrated. When it becomes hard to convince of obviously stupid things, that's when it starts to become a good counterpart for actual discussions... But right now it just isn't there yet.

digbybk 3y ago
Curious, have you seen examples of someone convincing it of something clearly wrong? Think I’ve seen examples of that with gpt3 but not 4 that I can recall.
- arlcode 3y ago
  I managed to "convince" it (in the playground as "discussGPT") to accept "temporary" physical barriers between racial groups and arrest and trial of rule breakers, as long as I confirmed the requirements of an integrated society in the long term. 3.5 is much more willing to go along but 4 will still play ball. It always added some moral requirements (humanity etc) but was otherwise ready to agree to my "sperate but equal" scenario.
  - hgsgm 3y ago
    > playground as "discussGPT" What's this?
    - arlcode 3y ago
      You can use the playgournd to give gpt-4 a custom system prompt. Mine was something like "You are discussGPT"
- stormking 3y ago
  I tried to convince it that powdered soup will cause the downfall of civilisation. It didn't call me a zealot but didn't really believe me either.
  - kevviiinn 3y ago
    You are right, though
__MatrixMan__ 3y ago
I'm more interested in one that includes conversations with people I've never met in its context. Not just training data based on some guy's blog post, but a back and forth where the other party knew something that I needed to know, convinced chatGPT of it, and now it's like they're in the room helping me with my problem even though they actually retired years before I entered the industry.
- hgsgm 3y ago
  For every 1 of those, there will be 1e6 spam ads injected.
  - __MatrixMan__ 3y ago
    1. Notice ad-like-behavior 2. Go find the ad in the training data 3. Revoke trust in whoever added it 4. Rebuild & Requery We're going to have to be a bit more hygienic about who we trust, but it's about time we did that anyway.

by erur 3y ago

digbybk 3y ago

Curious, have you seen examples of someone convincing it of something clearly wrong? Think I’ve seen examples of that with gpt3 but not 4 that I can recall.

arlcode 3y ago
I managed to "convince" it (in the playground as "discussGPT") to accept "temporary" physical barriers between racial groups and arrest and trial of rule breakers, as long as I confirmed the requirements of an integrated society in the long term. 3.5 is much more willing to go along but 4 will still play ball. It always added some moral requirements (humanity etc) but was otherwise ready to agree to my "sperate but equal" scenario.
- hgsgm 3y ago
  > playground as "discussGPT" What's this?
  - arlcode 3y ago
    You can use the playgournd to give gpt-4 a custom system prompt. Mine was something like "You are discussGPT"
stormking 3y ago
I tried to convince it that powdered soup will cause the downfall of civilisation. It didn't call me a zealot but didn't really believe me either.
- kevviiinn 3y ago
  You are right, though

__MatrixMan__ 3y ago

I'm more interested in one that includes conversations with people I've never met in its context. Not just training data based on some guy's blog post, but a back and forth where the other party knew something that I needed to know, convinced chatGPT of it, and now it's like they're in the room helping me with my problem even though they actually retired years before I entered the industry.

hgsgm 3y ago
For every 1 of those, there will be 1e6 spam ads injected.
- __MatrixMan__ 3y ago
  1. Notice ad-like-behavior 2. Go find the ad in the training data 3. Revoke trust in whoever added it 4. Rebuild & Requery We're going to have to be a bit more hygienic about who we trust, but it's about time we did that anyway.