7 ms·

There is degraded performance because GPT4 refuses to carry out certain tasks. To figure it out though, you must need to be able to switch between GPT4-0316 and

There is degraded performance because GPT4 refuses to carry out certain tasks. To figure it out though, you must need to be able to switch between GPT4-0316 and GPT4-0614. The task it is reluctant to do include: - legal advice - psychological guidance - complex programming tasks. IMO OpenAI is just backtracking on what it released to resegment their product into multiple offerings.

bredren 3y ago
>IMO OpenAI is just backtracking on what it released to resegment their product into multiple offerings. I think this is it, but also it is pulling back on the value of products if it reduces their compute costs. I'm hoping competition will be so fierce in this market that quality and opaque changes to priced LLM experiences won't be a thing for very long.
- kvetching 3y ago
  Hilarious because Google is taking the exact opposite approach. They released Bard as a terrible model to begin with, and now you can program and have it interpret images. It's been consistently improving. OpenAI really got sidetracked when they put out such a good model that freaked everyone out. Google saw this and decided to do the opposite to prevent too much attention. Now Google can improve quietly and nobody will notice.
ARandumGuy 3y ago
I think it's probably a good idea that GPT4 avoids legal or psychological tasks. Those are areas where giving incorrect output can have catastrophic consequences, and I can see why GPT4's developers want to avoid potential liability.
- SoftTalker 3y ago
  Yes, considering those are fields where humans have to be professionally educated and licensed, and also carry liabilty for any mistakes. It probably shouldn't be used for civil or mechanical engineering either.
  - hutzlibu 3y ago
    That's right, no serious work should be done with it. But programming is fine. https://xkcd.com/2030/ https://xkcd.com/2030/
- StackOverlord 3y ago
  I wasn't asking for advice. I was in fact exploring ways to measure employee performance (using GPT as a search engine) and criticized one of the assumptions in one of theoretical framework with my own experience. GPT retorted "burnout", I retorted "harassment grounded on material evidence", and it spitted a generic block about how it couldn't provide legal or psychological guidance. I wasn't asking for advice, it was just a point in a wider conversation. Switching to GPT-4-0314 it proceeded with a reply that matched the discussion main's topic (metrics in HR) switching it back to GPT-4-0613 it outputted the exact same generic block.
- kvetching 3y ago
  It's ridiculous. We should have access to a completely neutered version if we want it, we should just have to sign for access if they are worried about begin sued.

bredren 3y ago

>IMO OpenAI is just backtracking on what it released to resegment their product into multiple offerings. I think this is it, but also it is pulling back on the value of products if it reduces their compute costs. I'm hoping competition will be so fierce in this market that quality and opaque changes to priced LLM experiences won't be a thing for very long.

kvetching 3y ago
Hilarious because Google is taking the exact opposite approach. They released Bard as a terrible model to begin with, and now you can program and have it interpret images. It's been consistently improving. OpenAI really got sidetracked when they put out such a good model that freaked everyone out. Google saw this and decided to do the opposite to prevent too much attention. Now Google can improve quietly and nobody will notice.

ARandumGuy 3y ago

I think it's probably a good idea that GPT4 avoids legal or psychological tasks. Those are areas where giving incorrect output can have catastrophic consequences, and I can see why GPT4's developers want to avoid potential liability.

SoftTalker 3y ago
Yes, considering those are fields where humans have to be professionally educated and licensed, and also carry liabilty for any mistakes. It probably shouldn't be used for civil or mechanical engineering either.
- hutzlibu 3y ago
  That's right, no serious work should be done with it. But programming is fine. https://xkcd.com/2030/ https://xkcd.com/2030/
StackOverlord 3y ago
I wasn't asking for advice. I was in fact exploring ways to measure employee performance (using GPT as a search engine) and criticized one of the assumptions in one of theoretical framework with my own experience. GPT retorted "burnout", I retorted "harassment grounded on material evidence", and it spitted a generic block about how it couldn't provide legal or psychological guidance. I wasn't asking for advice, it was just a point in a wider conversation. Switching to GPT-4-0314 it proceeded with a reply that matched the discussion main's topic (metrics in HR) switching it back to GPT-4-0613 it outputted the exact same generic block.
kvetching 3y ago
It's ridiculous. We should have access to a completely neutered version if we want it, we should just have to sign for access if they are worried about begin sued.