7 ms·
Any bench that puts GLM 5.3 ahead of 5.6 Sol is highly sus. They've been my two daily drivers since release, and I like GLM 5.3, but it's definitely not better
by CuriouslyC 4d ago
Any bench that puts GLM 5.3 ahead of 5.6 Sol is highly sus. They've been my two daily drivers since release, and I like GLM 5.3, but it's definitely not better than Sol, it's more ~Terra, while being significantly slower.
- switchbak 4d agoI had exactly the same thoughts. I often have similar thoughts on other benchmark sites, where supposed performance is way off base from my experience. I’m not sure what the methodology of these are, but they certainly don’t match what I experience. Maybe I need to look deeper for relevant benchmarks.
- janaksunil 4d agothe tasks on the benchmar are long horizon swe tasks - where GLM does surprisingly well