4 ms·
Oh I didn’t know about the visual bounding boxes this is super cool! Quick question are you talking about this feature? https://docs.cloud.google.com/vertex-a
by lysecret 9mo ago
Oh I didn’t know about the visual bounding boxes this is super cool!
Quick question are you talking about this feature?
https://docs.cloud.google.com/vertex-ai/generative-ai/docs/bounding-box-detection https://docs.cloud.google.com/vertex-ai/generative-ai/docs/b...
Because it’s just using structured response so it should be doable with Gemini 3 ? (We are using Gemini 3 for some docs processing and its visual understanding is just incredible)
- simonw 9mo agoNo I'm talking about the image segmentation feature: https://simonwillison.net/2025/Apr/18/gemini-image-segmentation/ https://simonwillison.net/2025/Apr/18/gemini-image-segmentat... But the bounding box stuff might work well enough in Gemini 3 to handle this case as well.
- lysecret 9mo agoHmm so that post also links back to segmentation done by structured outputs? (Though here not even enforcing the structure) https://ai.google.dev/gemini-api/docs/image-understanding#segmentation https://ai.google.dev/gemini-api/docs/image-understanding#se...
- simonw 9mo agoIt's not supported by Gemini 3: https://ai.google.dev/gemini-api/docs/gemini-3#migrating_from_gemini_25 https://ai.google.dev/gemini-api/docs/gemini-3#migrating_fro... > Image segmentation: Image segmentation capabilities (returning pixel-level masks for objects) are not supported in Gemini 3 Pro or Gemini 3 Flash. For workloads requiring native image segmentation, we recommend continuing to utilize Gemini 2.5 Flash with thinking turned off or Gemini Robotics-ER 1.5.