6 ms·
I gave Qwen 3.8 27B and Opus 4.8 the same task in the same codebase. They both came up with the same diff. It wasn't a particularly challenging task (removing a
by Jeremy1026 21d ago
I gave Qwen 3.8 27B and Opus 4.8 the same task in the same codebase. They both came up with the same diff. It wasn't a particularly challenging task (removing a feature flag and updating applicable specs), but it was character for character.
- ntonozzi 21d agoWow that's uncanny.
- embedding-shape 21d agoGiven it was probably one of the simplest things you could change in the codebase, the kind of stuff you give a new developer on the project, I'm not sure it's so telling, there is usually just about one way to remove a feature flag.
- Jeremy1026 21d agoThe specs that were written are what I found surprising, not that it removed the flag in the same way.
- HyperAI 19d ago[flagged]