6 ms·
Do you think model trainers are pelicanmaxxing now?
by binarymax 15d ago
Do you think model trainers are pelicanmaxxing now?
- deleted 15d ago[deleted]
- mchinen 15d agoThere was a real probe into this, seems like no: https://dylancastillo.co/posts/pelicanmaxxing.html https://dylancastillo.co/posts/pelicanmaxxing.html https://news.ycombinator.com/item?id=49010129 https://news.ycombinator.com/item?id=49010129
- deleted 15d ago[deleted]
- parineum 15d agoI don't really see how replacing the vehicle and the animal is a good test. It'd be better to just have it draw a completely, linguistically, unrelated scene. Like, a single tree in a meadow bending in the wind.
- y-curious 15d agoThen it’s not a benchmark. I think his thesis is solid: if neither pelicans nor bicycles stick out, it follows that there isn’t special attention being given to them by the labs
- parineum 15d agoI do think that the bicycles stick out. They all look remarkably similar, aside from the DeepSeek test.
- CryptoBanker 15d agoFeels like it's been pretty obvious that they have been for a while now