4 ms·
I used perplexity for searches and I clicked on all sources that were given. Depending on the model used from 100% to 20% of the urls I tested did not exist. I
by shinycode 11mo ago
I used perplexity for searches and I clicked on all sources that were given. Depending on the model used from 100% to 20% of the urls I tested did not exist. I kept on querying the LLM about it and it finally told me that it generated « the most probable » urls for the topic in question based on the ones he knows exists. Useless.
- smrq 11mo agoI share your opinion on the results, but why would you trust the LLM explanation for why it does what it does?
- shinycode 11mo agoI don’t trust it at all. I wanted to know if he would be able to explain its own results. Just because it was displaying sources and links made me trust it until I checked and was horrified. I wanted to know if it was old link that broke or changed but no apparently
- macintux 11mo agoYou said: >...it finally told me that it generated « the most probable » urls for the topic in question based on the ones he knows exists. smrq is asking why you would believe that explanation. The LLM doesn't necessarily know why it's doing what it's doing, so that could be another hallucination. Your answer: > ...I wanted to know if it was old link that broke or changed but no apparently Leads me to believe that you misunderstood smrq's question.
- shinycode 11mo agoNo I got the question, I said that I wanted to see what kind of explanation it would give me. Ofc it can hallucinate that explanation as well. The bottom line is I don’t trust it, and the source link are fake (and not broken or obsolete)