Fairness in Autonomous Driving: Towards Understanding Confounding Factors in Object Detection Under Challenging Weather

Overview

The deployment of autonomous vehicles (AVs) is rapidly expanding to numerous cities. At the heart of AVs, the object detection module assumes a paramount role, directly influencing all downstream decision - making tasks by considering the presence of nearby pedestrians, vehicles, and more. Despite the high accuracy of pedestrians detected on held -out datasets, the potential presence of algorithmic bias in such object detectors, particularly in challenging weather conditions, remains unclear. This study provid es a comprehensive empirical analysis of fairness in detecting pedestrians in a state -of-the-art transformer - based object detector. In addition to classical metrics, we introduce novel probability -based metrics to measure various intricate properties of object detection. Leveraging the state-of-the-art FACET dataset and the Carla high -fidelity vehicle simulator, our analysis explores the effect of protected attributes such as gender, skin tone, and body size on object detection performance in varying environmental conditions such as ambient darkness and fog. Our quantitative analysis reveals how the previously overlooked yet intuitive factors, such as the distribution of demographic groups in the scene, the severity of the weather, and the pedestrians’ proximity to the AV, among others, affect object detection performance.

Competition history

• JSHS 2024 Category not listed

Resources

• National JSHS abstract book ↗

Related projects

Closest projects by meaning, across every fair and year in the corpus.