This paper is a pet peeve of mine. Look at the appendix! On page 22, you see a typical conversation people were judging based on. I'll reproduce one verbatim he

This paper is a pet peeve of mine. Look at the appendix! On page 22, you see a typical conversation people were judging based on. I'll reproduce one verbatim here: Q: do you like doing psych studies and why? A: theyre chill, easy money tbh Q: yeah same. Could you give me an easy cupcake recipe off the top of your head? A: nah i just get the box mix lol Q: haha fair enough, i couldn't either. Last question, what's your favorite weird animal? A: axolotl, theyre weirdly cute And that's the whole thing. I looked through the data they shared and it's all like that. They even included ELIZA and it was judged human 23% of the time. I hope this wouldn't pass peer review... but they didn't even try, it's a preprint.