11 ms·
Except, LLMs don’t cite their sources accurately (if at all). A Google search may yield information with a source I can verify; my understanding is that LLMs ar
by davb 3y ago
Except, LLMs don’t cite their sources accurately (if at all). A Google search may yield information with a source I can verify; my understanding is that LLMs are fundamentally incapable of doing so.
- 2devnull 3y agoIf one gave you a 10,000 page bibliography would you read all the sources? The same problem exists (long bibliographies) in human knowledge transfer. I’m suggesting this is an architectural issue, not a LLM problem per se. LLMs are not supposed to be AGI.
- creata 3y agoI never need to read all the sources, only the sources that are relevant to the bits that I'm referencing, no?
- 2devnull 3y agoIf you only need bits of info with citation, an LLM can do that. It’s synthesis that’s the problem. It’s true for humans as well.
- NBJack 3y agoAn actual citation and a string that happens to be formatted to look like a citation are very different. I wish we were at the point that most LLMs could do the former.
- hughesjj 3y agoI've seen the former happen for some GitHub docs and when enabling plugins. I agree there's cause for concern, and I hope it's a gradual rollout that's introspected in between each propagation of such, but I definitely think it's viable to be used no more less safely than other tooling in the government today (for better or worse).
- gmerc 3y agoAn LLM backed by an embedding store absolutely backs its sources. It’s a solved problem. But people cling to the narrative because that takes the fear away.