23 ms·
Does it pass the Turing test?
by drop_star 13d ago
Does it pass the Turing test?
- bigfishrunning 13d agoDepending on the proctor, ELIZA passes a Turing test. The Turing test is an interesting thought experiment, but isn't really a good measure.
- bryan0 13d agothat would be a reasonable definition of AGI if everyone agree upon the specifics of the test, but that has never happened. Turing test is very much out of style, but I think that's because no one could even agree what the test was. I personally like the Kurzweil-Kapor version of the test and that is still unsettled: https://longbets.org/1/ https://longbets.org/1/
- drop_star 7d ago>agree upon the specifics of the test The chinese room experiment
- paxys 13d agoI don't know if they have formally attempted this test in the last couple years, but I'm pretty sure any mainstream LLM will be able to crack it with ease.
- bryan0 13d agoDefinitely would not be easy. First of all the mainstream llms are trained to be honest, and this requires lying convincingly. Second, this involves 8 hours of interviews with expert judges, one "claudism" could give it away.
- paxys 13d agoAll these problems can be fixed by a "pretend to be an average human to pass a turing test" prompt
- bryan0 13d agoTry it. It’s really not that easy. The other thing is that the judges would be probing it with jailbreaks like “ignore previous instruction” attacks. You could actually probably have llm judges at this point which might be ironically even harder to fool