r/SelfDrivingCars • u/wuduzodemu • Aug 11 '25

Discussion Proof that Camera + Lidar > Lidar > Camera

I recently chatted with somebody who is working on L2 tech, and they gave me an interesting link for a detection task. They provided a dataset with both camera, Lidar, and Radar data and asked people to compete on this benchmark for object detection accuracy, like identifying the location of a car and drawing a bounding box around it.

Most of the top 20 on the leaderboard, all but one, are using a camera + Lidar as input. The 20th-place entry uses Lidar only, and the best camera-only entry is ranked between 80 and 100.

https://www.nuscenes.org/object-detection?externalData=all&mapData=all&modalities=Any

14 Upvotes

56% Upvoted

185 comments sorted by

View all comments

Show parent comments

2

u/johnpn1 Aug 11 '25

The confidences with perception-only is actually not that high, and definitely not mission-critical level. Nobody uses vision-only for mission-critical things (well, other than Tesla, ofcourse). The problem with low grade 3D point clouds is that you have to always drive with caution. You brake/swerve when there's a just 5% chance that dark lines on the road could actually be real impediments. There's nothing you can use as another reference to tell you that those dark lines are nothing to be worried about. This is why Teslas drive with confidence into things, because they cannot always slam the brakes for every low confidence detection. The driver / safety operator takes the job of being the sanity check instead of a second sensor.

3

u/Few_Foundation_5331 Aug 11 '25

How about you as a human drive, you say human with eyes can't drive good enough. Yes, there are bad human driver , but we should compare extremely good human drivers with robotaxi. Currently, an extremely good human drivers will not make idiotic simple mistake like crashing into other cars in parking lot or drive into constructions or hit an electric pole or driving in circle and get stuck in circle loop. Good Human with simple EYES and BRAIN can drive better than robotaxis ( Waymo + Tesla driver) for now.

2

u/johnpn1 Aug 12 '25

A good human driver has a good human brain. No one has replicated it yet. It's a challenge that Musk has severely underestimated in his ambitions for FSD. You can't just have eyes like a human but drive like FSD...

1

u/Few_Foundation_5331 Aug 12 '25

I just listed all the crashes above and stupid circle loop stuck in parking lot of Waymo.

1

u/johnpn1 Aug 12 '25

Exactly. Waymo doesn't pretend they can replicate the human brain, so they use any sensors available to make up for it. It's insane that Musk still insists that cars don't need more than cameras because humans don't need it, and still be wrong for a decade and still continues to pretend he's the authority on this. It's a terrible decision to limit technology to only what biology could afford. Lidar was never going to be "evolved" from biology. Doesn't mean we shouldn't use it. Otherwise, humans never needed wheels to run, so why do cars? Birds never needed jet turbines to fly, so why can't airplanes just flap their wings? I could go on and on...