Self-driving cars can't even manage 2 degrees of freedom with billions of driver-miles of data. What do you think can be done in 3d space, with more instruments

Self-driving cars can't even manage 2 degrees of freedom with billions of driver-miles of data. What do you think can be done in 3d space, with more instruments and many orders of magnitude of less data?