Fairness in Autonomous Driving: Towards Understanding Confounding Factors in Object Detection Under Challenging Weather
Overview
The deployment of autonomous vehicles (AVs) is rapidly expanding to numerous cities. At the heart of AVs, the object detection module assumes a paramount role, directly influencing all downstream decision - making tasks by considering the presence of nearby pedestrians, vehicles, and more. Despite the high accuracy of pedestrians detected on held -out datasets, the potential presence of algorithmic bias in such object detectors, particularly in challenging weather conditions, remains unclear. This study provid es a comprehensive empirical analysis of fairness in detecting pedestrians in a state -of-the-art transformer - based object detector. In addition to classical metrics, we introduce novel probability -based metrics to measure various intricate properties of object detection. Leveraging the state-of-the-art FACET dataset and the Carla high -fidelity vehicle simulator, our analysis explores the effect of protected attributes such as gender, skin tone, and body size on object detection performance in varying environmental conditions such as ambient darkness and fog. Our quantitative analysis reveals how the previously overlooked yet intuitive factors, such as the distribution of demographic groups in the scene, the severity of the weather, and the pedestrians’ proximity to the AV, among others, affect object detection performance.
Competition history
- JSHS 2024
Resources
Related projects
ISEF · 2018
Seeing Clearly and Farther: Augmented Perception for Safe Driving in Adverse Weather and Reduced Visibility Conditions
CSEF · 2026
Seeing Beyond the Scene: Analyzing and Mitigating Background Bias in Action Recognition
ISEF · 2024
Improving the Fairness of Artificially Intelligent Skin Disease Detectors Using Stable Diffusion
ISEF · 2025
Enhancing Pedestrian Safety Through AI-Powered Smart Traffic Systems: Developing Smarter Roads for Safer Walks
CSEF · 2016
Improved Machine Perception During Autonomous Driving via Semisupervised Deep Learning and Multisensor Datastream Fusion
ISEF · 2026
DermEquity: A Universal Safety Framework for Medical AI Using Worst-Case Bias Certification and Influence-Based Attribution Validated in Skin Cancer Screening
JSHS · 2024
A Computer Vision Based System to Make Street Crossings Safer for the Visually Impaired
JSHS · 2025
Preventing Traffic Accidents Involving Right-Turn-On-Red at Intersections with Edge AI
Closest projects by meaning, across every fair and year in the corpus.