5 ms·

How does he know that the response isn't just hallucinations? I'm telling it because I work there and I don't recognize any of those processes. In fact I foun

How does he know that the response isn't just hallucinations? I'm telling it because I work there and I don't recognize any of those processes. In fact I found one script named keepAliveJupyterSvc.sh in a public repo: https://github.com/shivamkm07/code-interpreter/blob/load-test/keepAliveJupyterSvc.sh https://github.com/shivamkm07/code-interpreter/blob/load-tes...

blastonico 1y ago
Oh boy, this really seems to be hallucination. Guys, chatbots are mostly token generators, they don't run programs e give you responses...it's not a simple shell program, it computes things in GPU and return tokens, in which are translated back to English.
- MattGaiser 1y ago
  This is very out of date. They now often trigger tooling and return the outputs of the tooling.
  - blastonico 1y ago
    Not really. You're referring to agents, but the model doesn't always require agents, and the public chatbot is not connected to a shell freely evaluating arbitrary commands.
    - blincoln 1y ago
      > and the public chatbot is not connected to a shell freely evaluating arbitrary commands. [ citation needed ]
    - brookst 1y ago
      This is false. Modern chatbots use tool orchestration where the LLM is given a list of tools it can use. Tools include things like searching the web and, yes, executing code. The LLM can generate arbitrary code (typically Python) and call a tool to execute it and return results. The tool takes the Python input, launches it (in a container in this example) and returns the output, which the LLM can further process.
eddythompson80 1y ago
That repo, and its contributors are MS/Azure employees working on the service for running python code in a container. I don't know why it's under a personal account. Though it says it's a fork from an Office repo that I can't find.
- what 1y ago
  How do you figure? I don’t see anything that suggest they work for ms/azure?
  - eddythompson80 1y ago
    The repo’s owner Employer listed on their profile? Also you can add .patch to any GitHub commit url and get a git patch file https://github.com/shivamkm07/code-interpreter/commit/5e282cd59cdaf847b33cece98741af18ffeb254f.patch https://github.com/shivamkm07/code-interpreter/commit/5e282c...
jon_adler 1y ago
It may not be a hallucination. Perhaps the Copilot code was generated from the GitHub training set?

blastonico 1y ago

Oh boy, this really seems to be hallucination. Guys, chatbots are mostly token generators, they don't run programs e give you responses...it's not a simple shell program, it computes things in GPU and return tokens, in which are translated back to English.

MattGaiser 1y ago
This is very out of date. They now often trigger tooling and return the outputs of the tooling.
- blastonico 1y ago
  Not really. You're referring to agents, but the model doesn't always require agents, and the public chatbot is not connected to a shell freely evaluating arbitrary commands.
  - blincoln 1y ago
    > and the public chatbot is not connected to a shell freely evaluating arbitrary commands. [ citation needed ]
  - brookst 1y ago
    This is false. Modern chatbots use tool orchestration where the LLM is given a list of tools it can use. Tools include things like searching the web and, yes, executing code. The LLM can generate arbitrary code (typically Python) and call a tool to execute it and return results. The tool takes the Python input, launches it (in a container in this example) and returns the output, which the LLM can further process.

eddythompson80 1y ago

That repo, and its contributors are MS/Azure employees working on the service for running python code in a container. I don't know why it's under a personal account. Though it says it's a fork from an Office repo that I can't find.

what 1y ago
How do you figure? I don’t see anything that suggest they work for ms/azure?
- eddythompson80 1y ago
  The repo’s owner Employer listed on their profile? Also you can add .patch to any GitHub commit url and get a git patch file https://github.com/shivamkm07/code-interpreter/commit/5e282cd59cdaf847b33cece98741af18ffeb254f.patch https://github.com/shivamkm07/code-interpreter/commit/5e282c...

jon_adler 1y ago

It may not be a hallucination. Perhaps the Copilot code was generated from the GitHub training set?