7 ms·

Thanks! I really love the visualization too. We have a hosted demo you can try as well! https://huggingface.co/spaces/Groundlight/grpo-vlm-decoder https://hugg

Thanks! I really love the visualization too. We have a hosted demo you can try as well! https://huggingface.co/spaces/Groundlight/grpo-vlm-decoder https://huggingface.co/spaces/Groundlight/grpo-vlm-decoder

oofbey 2y ago
Fun! I wish the demo had the attention visualization. Would that be easy to add? Is the source code for the HF demo in the repo too?
- skumar17 2y ago
  Unfortunately it might be a bit challenging as there’s a nontrivial amount of extra computation we do for the viz, but it’s probably possible?
  - skumar17 2y ago
    The attention demo code is in the /attention_demo directory if you want to try it on your own messages too :)