6 ms·

(I'm an engineer at OpenAI) Very sorry to hear about these issues, particularly the timeouts. Latency is top of mind for us and something we are continuing to

(I'm an engineer at OpenAI) Very sorry to hear about these issues, particularly the timeouts. Latency is top of mind for us and something we are continuing to push on. Does streaming work for your use case? https://github.com/openai/openai-cookbook/blob/main/examples/How_to_stream_completions.ipynb https://github.com/openai/openai-cookbook/blob/main/examples... We definitely want to investigate these and the billing issues further. Would you consider emailing me your org ID and any request IDs (if you have them) at atty@openai.com? Thank you for using the API, and really appreciate the honest feedback.

renewiltord 3y ago
Quick note: your domain doesn't appear to have an A record. I was hoping to follow the link in your profile and see if you have anything interesting written about LLMs.
- athyuttamre 3y ago
  Thanks! The website is no longer active, just updated my bio.
  - henry_viii 3y ago
    I know you guys are busy literally building the future but could you consider adding a search field in ChatGPT so that users can search their previous chats?
    - danenania 3y ago
      I'd also love to see a search field. That's my #1 feature request not related to the model.
jwr 3y ago
Streaming has no value for me, I need the entire response before I can do anything. I looked at streaming, but it seemed like a significant effort to implement, and with no obvious benefit — if I get 75% of my response through streaming and then something breaks, it doesn't get me anywhere. Thanks for offering help, I will contact you directly.
glintik 3y ago
> We definitely want to investigate these and the billing issues further. What’s a problem for OpenAI engineers to get web access logs and grep for 4xx/5xx errors?
esperent 3y ago
It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderline illegal billing practice. You guys are definitely aware that when there's a network error on the API or ChatGPT, the user still gets charged. And there's a lot of these errors. I get roughly one per hour or two. * Frustratingly loose interpretation of EU data protection rules. For example, the setting to say "don't use my personal chat data" is connected to the setting to save conversations. So you can't disable it without losing all your chat history. * Clearly nerfing the ChatGPT v4 products, at least according to hundreds or even thousands of commenters here and on reddit, while denying to have made any changes. * Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour). * Not to mention the huge questions around the secret training dataset and whether large portions of it consist of illegally obtained private data (see the recent class court case in California)
- dontupvoteme 3y ago
  They also no longer support data exports for many users (including myself) - at one point it worked but now it says you'll receive an email to download your data, which never arrives.
- km3r 3y ago
  > Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour). What is wrong about injecting millions into developing nations? The rest I agree with, although I don't think it was ever really 'open' so its not getting shitty, it always was. Thankfully, "there is no moat" and other LLMs will be open, just a few months behind OpenAI
  - esperent 3y ago
    > What is wrong about injecting millions into developing nations? Please don't try to reframe this to make exploitation a positive thing. See my other comment here. https://news.ycombinator.com/item?id=36625438 https://news.ycombinator.com/item?id=36625438
DomKM 3y ago
While you're here, you should know that the logic for enabling GPT-4 API access is excluding Microsoft for Startups (https://openai.com/microsoft-for-startups https://openai.com/microsoft-for-startups) orgs which have valid billing against Microsoft-provided credits. Presumably, this is an oversight as it wouldn't make sense to exclude pre-existing Microsoft partners. Would you mind escalating this?
- athyuttamre 3y ago
  Thanks for pointing this out. Sharing with the relevant folks.
  - jiggawatts 3y ago
    This is precisely what is wrong with OpenAI. This. Right here. "Complaining on HN will get you access. You have know people or "complain in the right forums." THERE SHOULD BE NO LOGIC. No qualifying rules. No access checks. No gates. No hoops. Sam Altman has gone on a worldwide interview tour claiming he wants to "democratise access to AI", meanwhile OpenAI is the least open company I have ever dealt with, or even heard of. Oracle is more "democratic" and open, for crying out loud.

renewiltord 3y ago

Quick note: your domain doesn't appear to have an A record. I was hoping to follow the link in your profile and see if you have anything interesting written about LLMs.

athyuttamre 3y ago
Thanks! The website is no longer active, just updated my bio.
- henry_viii 3y ago
  I know you guys are busy literally building the future but could you consider adding a search field in ChatGPT so that users can search their previous chats?
  - danenania 3y ago
    I'd also love to see a search field. That's my #1 feature request not related to the model.

jwr 3y ago

Streaming has no value for me, I need the entire response before I can do anything. I looked at streaming, but it seemed like a significant effort to implement, and with no obvious benefit — if I get 75% of my response through streaming and then something breaks, it doesn't get me anywhere. Thanks for offering help, I will contact you directly.

glintik 3y ago

> We definitely want to investigate these and the billing issues further. What’s a problem for OpenAI engineers to get web access logs and grep for 4xx/5xx errors?

esperent 3y ago

It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderline illegal billing practice. You guys are definitely aware that when there's a network error on the API or ChatGPT, the user still gets charged. And there's a lot of these errors. I get roughly one per hour or two. * Frustratingly loose interpretation of EU data protection rules. For example, the setting to say "don't use my personal chat data" is connected to the setting to save conversations. So you can't disable it without losing all your chat history. * Clearly nerfing the ChatGPT v4 products, at least according to hundreds or even thousands of commenters here and on reddit, while denying to have made any changes. * Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour). * Not to mention the huge questions around the secret training dataset and whether large portions of it consist of illegally obtained private data (see the recent class court case in California)

dontupvoteme 3y ago
They also no longer support data exports for many users (including myself) - at one point it worked but now it says you'll receive an email to download your data, which never arrives.
km3r 3y ago
> Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour). What is wrong about injecting millions into developing nations? The rest I agree with, although I don't think it was ever really 'open' so its not getting shitty, it always was. Thankfully, "there is no moat" and other LLMs will be open, just a few months behind OpenAI
- esperent 3y ago
  > What is wrong about injecting millions into developing nations? Please don't try to reframe this to make exploitation a positive thing. See my other comment here. https://news.ycombinator.com/item?id=36625438 https://news.ycombinator.com/item?id=36625438

DomKM 3y ago

While you're here, you should know that the logic for enabling GPT-4 API access is excluding Microsoft for Startups (https://openai.com/microsoft-for-startups https://openai.com/microsoft-for-startups) orgs which have valid billing against Microsoft-provided credits. Presumably, this is an oversight as it wouldn't make sense to exclude pre-existing Microsoft partners. Would you mind escalating this?

athyuttamre 3y ago
Thanks for pointing this out. Sharing with the relevant folks.
- jiggawatts 3y ago
  This is precisely what is wrong with OpenAI. This. Right here. "Complaining on HN will get you access. You have know people or "complain in the right forums." THERE SHOULD BE NO LOGIC. No qualifying rules. No access checks. No gates. No hoops. Sam Altman has gone on a worldwide interview tour claiming he wants to "democratise access to AI", meanwhile OpenAI is the least open company I have ever dealt with, or even heard of. Oracle is more "democratic" and open, for crying out loud.