7 ms·
AI rating AI? Am I missing something.
by bluealienpie 2mo ago
AI rating AI? Am I missing something.
- zahlman 2mo agoThat seems to be how we signal "objectivity" nowadays.
- recursive 2mo agoMissing something? You're missing the boat! Have some AI-prepared koolaid before you get left behind.
- Nnnes 2mo agoI'm surprised (but not really) that you're the only comment I see even mentioning it. The ratings may be even lower quality than the SVGs. Obviously they're all a bit cartoon-y, what else do you expect from SVGs. But I'm not convinced you could find a single human on Earth over the age of 4 who would seriously give the vehicle in GPT/1/whale/plane a 5/5. Browse through the options a bit and the rest is not that much better. Grok/2/cat/plane, one of the more accurate planes, got a 2/5. For the most part, vehicles entirely missing do get a 1/5, except for whatever it is in Gemini/1/heron/plane scoring 4. Animals inside planes get completely random vehicle scores I guess. The cats are all orange, except for a few of the skateboard cats that are black. I'm sure there's nothing to read into there... Well, I've convinced myself that the next effective test of multimodal models will be whether their judgments of LLM-generated SVG airplanes are anywhere close to reasonable.