6 ms·
Can anyone comment on an open source multi-modal LLM that can produce structured outputs based on an image? I have not found a good open source one yet (this in
by jn2clark 3y ago
Can anyone comment on an open source multi-modal LLM that can produce structured outputs based on an image? I have not found a good open source one yet (this included), seems to be only closed source that can do this reliably well. Any suggestions are very welcome!
- addandsubtract 3y agoI've only used LLaVA / BakLLaVA. It falls under the LLAMA 2 Community License. Not sure if you consider that open source or not.
- isaacfung 3y agoSomething like this? https://imgur.com/a/hPAaZUv https://imgur.com/a/hPAaZUv https://huggingface.co/spaces/Qwen/Qwen-VL-Plus https://huggingface.co/spaces/Qwen/Qwen-VL-Plus You can also ask it to give you bounding boxes of objects.