Self-driving cars and other autonomous vehicles (AVs) depend on a combination of imaging sensors and object detection algorithms to avoid other vehicles, pedestrians, and obstacles on the road. To perform well in diverse driving conditions, these object detection models must fuse information from various sensor modalities like RGB cameras, LiDAR, and thermal cameras in a technique known as “deep sensor fusion.”
