I would imagine SAM being a very interesting technology for robots like this. SAM 2D segmentation to 3D projection, clustering/object segmentation based on this

I would imagine SAM being a very interesting technology for robots like this. SAM 2D segmentation to 3D projection, clustering/object segmentation based on this initial guess, then a grasping neural net.