4 ms·
The fact that GPT-4.1 was the judge does not convince of the validity of the bench.
by nahnahno 11mo ago
The fact that GPT-4.1 was the judge does not convince of the validity of the bench.
- tacoooooooo 11mo agoit's an odd choice. I'd be curious why they picked that. it's not the cheapest, most expensive, best, or worst. It does have a relatively large context window, and ime is very good at format adherence
- lukaslevert 11mo agoYou may be looking at our first benchmarks on the homepage— the latest ones for the Search API were conducted against GPT-5: https://parallel.ai/blog/introducing-parallel-search https://parallel.ai/blog/introducing-parallel-search
- ripped_britches 11mo agoIt’s probably just that they started before gpt 5 was released. It’s a good judge.