lakshith-403

6 ms·

1. 1.▲
   by lakshith-403 2y ago

   Thank you
2. 2.▲
   by lakshith-403 2y ago

   Interesting. I think OpenAI here uses sparse autoencoders to map out sparse activation patterns in networks. Comparing them to how a real person reasons about a situations. Inspectus, on the other hand is a general tool to visualize how tra
3. 3.▲
   by lakshith-403 2y ago

   I'm not a primary user. Just cleaned up the existing codebase to make it open source. But you could use this to visualise attentions and debug the model. For an example if you're working on a Q&A model, you can check which tok
4. 4.▲
   Show HN: We've open-sourced our LLM attention visualization library(github.com)

   197 points by lakshith-403 2y ago|15 comments