4 ms·
This is insane, when you say azure OpenAI, do you mean like github copilot, microsoft copilot, hitting openai’s api, or some openai llm hosted on azure offering
by jmogly 6mo ago
This is insane, when you say azure OpenAI, do you mean like github copilot, microsoft copilot, hitting openai’s api, or some openai llm hosted on azure offering that you hit through azure? This is some real wild west crap!
- nkozyra 6mo agoThe latter, their arrangement with OpenAI enabled this.
- pratyushnair01 6mo agoI have noticied a similar bug on Copilot. I noticed a chat session with questions that I had no recollection of asking. I wonder if it's related. I brushed it off as the question was generic.
- Manouchehri 6mo agoI would guess that Copilot uses Azure OpenAI. In my small sample size of a bit over a 100 accidentally leaked messages, many/most of them are programming related questions. It's easy to brush it off as just LLM hallucinations. Azure OpenAI actually shows me how many input tokens were billed, and how many input tokens checked by the content filter. For these leaked responses, I was only billed for 8 input tokens, yet the content filter (correctly) checked >40,000 chars of input token (which was my actual prompt's size).
- SahAssar 6mo agoI'd assume they mean https://azure.microsoft.com/en-us/products/ai-foundry/models/openai/ https://azure.microsoft.com/en-us/products/ai-foundry/models...
- Manouchehri 6mo agoCorrect.