6 ms·
A YouTuber named DirtyTesla has done a series of drives over the years throughout his hometown where he's tracked the intervention and disengagement rates per m
by xendipity 3y ago
A YouTuber named DirtyTesla has done a series of drives over the years throughout his hometown where he's tracked the intervention and disengagement rates per mile. He often shows those numbers at the end of his videos.
- mg 3y agoIs it the same route every time? If not, they might take harder and harder routes as FSD gets better. Making it look like there is less progress than there really is.
- buro9 3y agoYou just know that Tesla would tune the software for this specific route, if the value of the comparison number became meaningful. Just like you cannot trust benchmarks, Goodhart's law will kick in https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law > Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes
- mensetmanusman 3y agoTheir model architecture don't allow for individual route tuning.
- krisoft 3y agoI think that is not true. They can just take data from the route, annotate it and put it into their training set. That is how you would do route tuning.
- tsimionescu 3y agoThey claim.
- mlrtime 3y agoSort of off-topic but I believe Openpilot allows this. You can record every route you take, copy it off to your PC and run it in a simulator. You can then tweak the model for this particular issue.
- numpad0 3y agoThere is no publicly known archive of Tesla software images, at all. Which, with the benefit of hindsight, do sound wrong.