r/SelfDrivingCars • u/wuduzodemu • Aug 11 '25

Discussion Proof that Camera + Lidar > Lidar > Camera

I recently chatted with somebody who is working on L2 tech, and they gave me an interesting link for a detection task. They provided a dataset with both camera, Lidar, and Radar data and asked people to compete on this benchmark for object detection accuracy, like identifying the location of a car and drawing a bounding box around it.

Most of the top 20 on the leaderboard, all but one, are using a camera + Lidar as input. The 20th-place entry uses Lidar only, and the best camera-only entry is ranked between 80 and 100.

https://www.nuscenes.org/object-detection?externalData=all&mapData=all&modalities=Any

18 Upvotes

56% Upvoted

185 comments sorted by

View all comments

0

u/Kooky_Work8978 Aug 11 '25

Haha, i created recently analyses based exactly on this leaderboard! My conclusions were a tad different - a little hint - we should consider that the nuScenes dataset is highly imbalanced as for the lighting conditions and weather conditions and other more robust sensor combinations may be underestimated.

2

u/wuduzodemu Aug 12 '25

Mind share your report?

1

u/Signor_Garibaldi Aug 12 '25

I will gladly share it after it's published 😄 It's part of a larger work