5 ms·
I've really been enjoying their series on mech interp, does anyone have any other good recs?
by gautomdas 2y ago
I've really been enjoying their series on mech interp, does anyone have any other good recs?
- kromem 2y agoThe Othello-GPT and Chess-GPT lines of work. Was the first research work that clued me into what Anthropic's work today ended up demonstrating.
- PoignardAzur 2y ago"Transformers Represent Belief State Geometry in their Residual Stream": https://www.lesswrong.com/posts/gTZ2SxesbHckJ3CkF/transformers-represent-belief-state-geometry-in-their https://www.lesswrong.com/posts/gTZ2SxesbHckJ3CkF/transforme... Basically finding that transformers don't just store a world-model as in "what does the world that produce the observed inputs look like?", they store a "Mixed-State Presentation", basically a weighted set of possible worlds that produce the observed inputs.