4 ms·
Can any LLM give you the rough pixel coordinates of an item it identifies in an image? I found that while Claude, GPT etc could describe an image, there was no
by mootothemax 3mo ago
Can any LLM give you the rough pixel coordinates of an item it identifies in an image?
I found that while Claude, GPT etc could describe an image, there was no way to link the description back to specific pixels in the image itself. Not even to a bounding box or segment.
- gs17 3mo agoNot as smart as modern frontier models, but Moondream and Molmo can do that sort of thing.