5 ms·
A bit of a meta question: what are the most relevant benchmarks by now?
by dgellow 4d ago
A bit of a meta question: what are the most relevant benchmarks by now?
- andriy_koval 4d agoNvidia and OpenAI claimed AGI, but you still have a job.
- tetec1 4d agoEpoch.ai has a global score and tracks many benchmarks: https://epoch.ai/benchmarks https://epoch.ai/benchmarks
- redox99 4d agoTerminal bench 4 is good largely because it's recent so it hasn't been benchmaxxed yet. It's more of a sysadmin/devops benchmark than a coding benchmark though, but still a decent proxy. https://artificialanalysis.ai/evaluations/terminalbench-v4-0 https://artificialanalysis.ai/evaluations/terminalbench-v4-0
- taintech 3d agoI think openrca https://github.com/microsoft/OpenRCA https://github.com/microsoft/OpenRCA is quite interesting