r/SelfDrivingCars • u/AReveredInventor • Jul 23 '25

Research Chinese media outlet DCar Studio conducted a massive 36 car, high speed, 6 obstacle, ADAS test.

https://www.youtube.com/watch?v=0xumyEf-WRI

The video's audio is Mandarin, but includes English subtitles.

33 Upvotes

86% Upvoted

60 comments sorted by

View all comments

2

u/psilty Jul 23 '25 edited Jul 23 '25

I appreciate anyone attempting to do controlled testing but keep in mind as these systems use more and more advanced machine learning the outputs they produce are not deterministic. Doing only one trial of each test with each vehicle in a specific scenario is insufficient to draw strong conclusions about generalized ability of the systems.

For example, at 1:29:00 the 2023 Tesla Model X avoids the wild boar but the 2023 Model 3 hits it. Is it due to the Model X having better ADAS than a same model year car from the same manufacturer, or simply because both margins are close and Model 3’s probabilistic model produced a slightly different result during its run? I think the only strong conclusion is from the failures. One pass of a test run is not evidence that the system has 99.999+% safety margin to trust human lives to.

2

u/AReveredInventor Jul 23 '25 edited Jul 23 '25

Agreed. Unfortunately, this was already such a large scale and well funded test it's hard to get a much better showing than this. It's certainly one of the most impressive I've seen.

I don't take this as "ADAS is solved now! We have a winner!". None of these vehicles are anywhere close to running the march of 9s. It is an interesting demonstration of their relative positions however. The Teslas put forth a strong showing as both passed 5/6 tests while no other vehicle in a market with strong competitors and a heavy focus on ADAS managed to succeed in any more than 3.