Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range

David S. Bolme, Deniz Aykac, Ryan Shivers, Joel Brogan, Nell Barber, Bob Zhang, Laura Davies, David Cornett

TL;DR

This work addresses the challenge of understanding covariate effects on multimodal biometric recognition at altitude and range using the IARPA BRIAR dataset. It combines a log-based score normalization approach, $\log_{10}(\text{FAR})$, with a linear mixed-model framework that includes fixed effects for covariates and grouped sensor-collection factors to reveal influential predictors. Key findings show that resolution, camera distance, head height in pixels, and modality strongly influence accuracy, while weather factors such as solar loading also modulate performance; turbulence has a limited impact given data constraints. The results offer a practical basis for designing more robust long-range and UAV-based biometric systems and inform future research directions in multimodal biometrics for security-critical applications.

Abstract

This paper examines covariate effects on fused whole body biometrics performance in the IARPA BRIAR dataset, specifically focusing on UAV platforms, elevated positions, and distances up to 1000 meters. The dataset includes outdoor videos compared with indoor images and controlled gait recordings. Normalized raw fusion scores relate directly to predicted false accept rates (FAR), offering an intuitive means for interpreting model results. A linear model is developed to predict biometric algorithm scores, analyzing their performance to identify the most influential covariates on accuracy at altitude and range. Weather factors like temperature, wind speed, solar loading, and turbulence are also investigated in this analysis. The study found that resolution and camera distance best predicted accuracy and findings can guide future research and development efforts in long-range/elevated/UAV biometrics and support the creation of more reliable and robust systems for national security and other critical domains.

From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range

TL;DR

This work addresses the challenge of understanding covariate effects on multimodal biometric recognition at altitude and range using the IARPA BRIAR dataset. It combines a log-based score normalization approach, , with a linear mixed-model framework that includes fixed effects for covariates and grouped sensor-collection factors to reveal influential predictors. Key findings show that resolution, camera distance, head height in pixels, and modality strongly influence accuracy, while weather factors such as solar loading also modulate performance; turbulence has a limited impact given data constraints. The results offer a practical basis for designing more robust long-range and UAV-based biometric systems and inform future research directions in multimodal biometrics for security-critical applications.

Abstract

This paper examines covariate effects on fused whole body biometrics performance in the IARPA BRIAR dataset, specifically focusing on UAV platforms, elevated positions, and distances up to 1000 meters. The dataset includes outdoor videos compared with indoor images and controlled gait recordings. Normalized raw fusion scores relate directly to predicted false accept rates (FAR), offering an intuitive means for interpreting model results. A linear model is developed to predict biometric algorithm scores, analyzing their performance to identify the most influential covariates on accuracy at altitude and range. Weather factors like temperature, wind speed, solar loading, and turbulence are also investigated in this analysis. The study found that resolution and camera distance best predicted accuracy and findings can guide future research and development efforts in long-range/elevated/UAV biometrics and support the creation of more reliable and robust systems for national security and other critical domains.
Paper Structure (12 sections, 4 equations, 6 figures, 6 tables)

This paper contains 12 sections, 4 equations, 6 figures, 6 tables.

Table of Contents

  1. Introduction
  2. Dataset Composition
  3. Dataset
  4. Curation and Metadata
  5. Experimental Protocol Composition
  6. Correlated Variables and Interactions
  7. Score Normalization
  8. Linear Model of Results
  9. Discussion
  10. Future Work
  11. Conclusions
  12. Acknowledgments

Figures (6)

  • Figure 1: The provided samples demonstrate the range of image quality in videos from the second collection. The individuals have clear features in the images taken from 600 m and 1000 m. At 800 m, some distortion can be observed due to turbulence. The UAV image exhibits a range of quality issues, such as low resolution, blurring, atmospheric problems, and compression artifacts.
  • Figure 2: Collection ID, Camera Location, and Head Height
  • Figure 3: This figure shows a summary of the weather.
  • Figure 4: This figure shows the interactions between sensor model and distance. Also shown is the distance range at which each sensor has been deployed. I THINK WE NEED TO ANONIMIZE THE SENSOR IDS AS COTS A, CUSTOM B, UAV C. SINCE THIS IS A LINEAR FIT, EACH LINE SHOULD ONLY HAVE A POINT AT THE BEGINNING AND END.
  • Figure 5: Top: This row shows that the score to $\log_{10}(\text{FAR})$ fits are linear for all systems. Middle: Show that all systems scores correlate strongly with the mean with a potential exception of System A which shows some unique behavior. Bottom: Shows the genuine and impostor score distributions after normalization with the region used for normalization within the dotted lines. THERE ARE FORMATTING ISSUES WITH THE LEFT LABELS.
  • ...and 1 more figures