12 ms·

That so weird, it’s seems like everybody here prefers Claude. I’ve been using Claude and openai in copilot and I find even 4o seems to understand the problem

by h_tbob 2y ago

That so weird, it’s seems like everybody here prefers Claude. I’ve been using Claude and openai in copilot and I find even 4o seems to understand the problem better. O1 definitely seems to get it right more for me.

master_crab 2y ago
Claude also has a better workflow UI. It’ll maintain conversation context while opening up new windows to present code suggestions. When I was still subscribing to OpenAI (about 4 months ago) this didn’t exist.
- rrrrrrrrrrrryan 2y ago
  It exists as of last week with Canvas.
- fragmede 2y ago
  If you're using the web interface of either, you might consider looking into tools that focus on using LLMs for code, so you're not copy/pasting.
A_D_E_P_T 2y ago
They're both okay for coding, though for my use cases (which are niche and involve quite a lot of mathematics and formal logic) o1/o1-Pro is better. It seems to have a better native grasp of mathematical concepts, and it can even answer very difficult questions from vague inputs, e.g.: https://chatgpt.com/share/676020cb-8574-8005-8b83-4bed5b13e1cd https://chatgpt.com/share/676020cb-8574-8005-8b83-4bed5b13e1...
- deleted 2y ago
  [deleted]
orbital-decay 2y ago
Different languages maybe? I find Sonnet v2 to be lacking in Rust knowledge compared to 4o 11-20, but excelling at Python and JS/TS. O1's strong side seems to be complex or quirky puzzle-like coding problems that can be answered in a short manner, it's meh at everything else, especially considering the price. Which is understandable given its purpose and training, but I have no use for it as that's exactly the sort of problem I wouldn't trust an LLM to solve. Sonnet v2 in particular seems to be a bit broken with its reasoning (?) feature. The one where it detects it might be hallucinating (what's even the condition?) and reviews the reply, reflecting on it. It can make it stop halfway into the reply and decide it wrote enough, or invent some ridiculous excuse to output a worse answer. Annoying, although it doesn't trigger too often.
anonzzzies 2y ago
I try to sprinkle 'for us/me' everywhere as much as I can; we work on LoB/ERP apps mostly. These are small frontends to massive multi million line backends. We carved a niche by providing the frontends on these backends live at the client office by a business consultant of ours: they simply solve UX issues for the client on top of large ERP by using our tool and prompting. Everything looks modern, fresh and nice; unlike basically all the competitors in this space. It's fast and no frontend people are needed for it; backend is another system we built which takes a lot longer of course as they are complex business rules. Both claude and o1 turn up something that looks similar but only the claude version will work and be, after less prompting, correct. I don't have shares in either and I want open source to win; we have all open (more open) solutions doing all the same queries and we evaluate all but claude just wins. We did manage even big wins with openai davinci in 2022 (or so; before chatgpt), but this is a massive boost allowing us to upgrade most people to business consultant and just have them build with clients real time and have the tech guys including me add manually tests and proofs (where needed) to know if we are actually fine. Works so much better than the slog with clients before; people are so bad at explaining at what they need, it was slowly driving me insane after doing it for 30+ years.
- dmix 2y ago
  > It's fast and no frontend people are needed for it I guess if you don’t need to maintain it, just an ever growing blob of complexity that will be reinvented into new blobs every time when the old one becomes too immobile :)
  - a_wild_dandan 2y ago
    So...nothing will change?
    - dmix 2y ago
      True I could imagine in the ERP world building one-off solutions repeatedly for tons of consulting money is the status quo. Most software businesses can't afford repeatedly starting from scratch and having zero reusability of stuff they already invested in getting working and tested, even with AI assistance.
mitemte 2y ago
Claude web’s context window is 200K tokens. I’d be surprised if GitHub Copilot’s context window exceeds 10K. I’ve found using Claude via Copilot in VS Code produces noticeably lower quality results than 3.5 Sonnet on web. In my experience Claude web outdoes GPT-4o consistently.

by h_tbob 2y ago

master_crab 2y ago

Claude also has a better workflow UI. It’ll maintain conversation context while opening up new windows to present code suggestions. When I was still subscribing to OpenAI (about 4 months ago) this didn’t exist.

rrrrrrrrrrrryan 2y ago
It exists as of last week with Canvas.
fragmede 2y ago
If you're using the web interface of either, you might consider looking into tools that focus on using LLMs for code, so you're not copy/pasting.

A_D_E_P_T 2y ago

They're both okay for coding, though for my use cases (which are niche and involve quite a lot of mathematics and formal logic) o1/o1-Pro is better. It seems to have a better native grasp of mathematical concepts, and it can even answer very difficult questions from vague inputs, e.g.: https://chatgpt.com/share/676020cb-8574-8005-8b83-4bed5b13e1cd https://chatgpt.com/share/676020cb-8574-8005-8b83-4bed5b13e1...

deleted 2y ago
[deleted]

orbital-decay 2y ago

Different languages maybe? I find Sonnet v2 to be lacking in Rust knowledge compared to 4o 11-20, but excelling at Python and JS/TS. O1's strong side seems to be complex or quirky puzzle-like coding problems that can be answered in a short manner, it's meh at everything else, especially considering the price. Which is understandable given its purpose and training, but I have no use for it as that's exactly the sort of problem I wouldn't trust an LLM to solve. Sonnet v2 in particular seems to be a bit broken with its reasoning (?) feature. The one where it detects it might be hallucinating (what's even the condition?) and reviews the reply, reflecting on it. It can make it stop halfway into the reply and decide it wrote enough, or invent some ridiculous excuse to output a worse answer. Annoying, although it doesn't trigger too often.

anonzzzies 2y ago

I try to sprinkle 'for us/me' everywhere as much as I can; we work on LoB/ERP apps mostly. These are small frontends to massive multi million line backends. We carved a niche by providing the frontends on these backends live at the client office by a business consultant of ours: they simply solve UX issues for the client on top of large ERP by using our tool and prompting. Everything looks modern, fresh and nice; unlike basically all the competitors in this space. It's fast and no frontend people are needed for it; backend is another system we built which takes a lot longer of course as they are complex business rules. Both claude and o1 turn up something that looks similar but only the claude version will work and be, after less prompting, correct. I don't have shares in either and I want open source to win; we have all open (more open) solutions doing all the same queries and we evaluate all but claude just wins. We did manage even big wins with openai davinci in 2022 (or so; before chatgpt), but this is a massive boost allowing us to upgrade most people to business consultant and just have them build with clients real time and have the tech guys including me add manually tests and proofs (where needed) to know if we are actually fine. Works so much better than the slog with clients before; people are so bad at explaining at what they need, it was slowly driving me insane after doing it for 30+ years.

dmix 2y ago
> It's fast and no frontend people are needed for it I guess if you don’t need to maintain it, just an ever growing blob of complexity that will be reinvented into new blobs every time when the old one becomes too immobile :)
- a_wild_dandan 2y ago
  So...nothing will change?
  - dmix 2y ago
    True I could imagine in the ERP world building one-off solutions repeatedly for tons of consulting money is the status quo. Most software businesses can't afford repeatedly starting from scratch and having zero reusability of stuff they already invested in getting working and tested, even with AI assistance.

mitemte 2y ago

Claude web’s context window is 200K tokens. I’d be surprised if GitHub Copilot’s context window exceeds 10K. I’ve found using Claude via Copilot in VS Code produces noticeably lower quality results than 3.5 Sonnet on web. In my experience Claude web outdoes GPT-4o consistently.