5 ms·
I’ve chipped on it with each model since 5.2 but 5.6 sol is something else. When it first came out I’d get some refusals but they’ve since stopped. I wonder wha
by CompoundEyes 29d ago
I’ve chipped on it with each model since 5.2 but 5.6 sol is something else. When it first came out I’d get some refusals but they’ve since stopped. I wonder what an ideal candidate benchmark task would be for that?
- brynnbee 29d ago5.6 has been a huge pivotal change in reverse engineering tasks for me too (largely extracting game assets from binary client files). Something I spent literally weeks on in January with claude models at the time was solved in about 30 minutes with 5.6 Sol at medium just yesterday. It's both extremely satisfying but at the same time also a little annoying how much time I had previously spent on it only for it to be solved so quickly now. I suspect improvements in AI will continue this happy but annoyed trend.