6 ms·
They can do this in people, too, not just LLMs. Imagine the mistakes that can be made by changing one fact but not reconfiguring the whole network. Thhese guy
by pffft8888 3y ago
They can do this in people, too, not just LLMs.
Imagine the mistakes that can be made by changing one fact but not reconfiguring the whole network.
Thhese guys remind me of when I used to change EXEs in hex editors then notice "unrelated" weird glitches.
- mrtranscendence 3y agoThat’s what I’d be afraid of, though I haven’t read the relevant literature so maybe this is addressed. Since there are way fewer parameters than encoded facts it seems like it would be difficult to change one fact without messing with others.