5 ms·
Kaggle Launches LLM Evals
- antgoldbloom 1y agoHere’s the announcement https://www.kaggle.com/blog/announcing-kaggle-benchmarks https://www.kaggle.com/blog/announcing-kaggle-benchmarks I was founder and ceo of kaggle. I’ve been out of kaggle for 2.5 years. Super excited to see this announcement. Could solve the biggest problem in the LLM ecosystem.
- art82135 1y agoCurious how does it compare to Chat Arena?
- meganrisdal 1y agoWe love what Chatbot Arena is doing to innovate on evaluation paradigms. The challenge of evaluating GenAI warrants diverse approaches. What we're excited to do is: 1) give anyone access to infra to make evaluation more accessible to more developers and researchers; 2) drive more novel, diverse evals. https://arxiv.org/abs/2505.00612v2 https://arxiv.org/abs/2505.00612v2
- jaimiehwang88 1y ago[dead]
- benhamner 1y agoCan we add our own models or benchmarks?