5 ms·
Results from my Extended NYT Connections benchmark: GPT-5.4 extra high scores 94.0 (GPT-5.2 extra high scored 88.6). GPT-5.4 medium scores 92.0 (GPT-5.2 mediu
by zone411 7mo ago
Results from my Extended NYT Connections benchmark:
GPT-5.4 extra high scores 94.0 (GPT-5.2 extra high scored 88.6).
GPT-5.4 medium scores 92.0 (GPT-5.2 medium scored 71.4).
GPT-5.4 no reasoning scores 32.8 (GPT-5.2 no reasoning scored 28.1).
- stavros 7mo agoHow do you score this? Losing/winning the game with 4 lives?
- oliwary 7mo agoImpressive! Do you include puzzles released before the training data cutoff date?
- kinderjaje 7mo agoI added that info on https://automatio.ai/models/gpt-5-4 https://automatio.ai/models/gpt-5-4