5 ms·
I'm no more trusting the benchmarks. other than trying it out myself, what else can we do here?
by shnkr 2y ago
I'm no more trusting the benchmarks. other than trying it out myself, what else can we do here?
- refulgentis 2y agoIt's already been done (ELO, see LMSYS rankings). I hope we're cresting past the 50% percentile mark of people who haven't heard of it.
- shnkr 2y agoI see. thanks for the reference. followed it on x now. https://twitter.com/lmsysorg/status/1772759835714728217 https://twitter.com/lmsysorg/status/1772759835714728217