Multi-modal biometric authentication: Leveraging shared layer architectures for enhanced security

TL;DR

A novel multi-modal biometric authentication system that integrates facial, vocal, and signature data to enhance security measures and demonstrates significant improvements in authentication accuracy and robustness, paving the way for advanced secure identity verification solutions.

Abstract

In this study, we introduce a novel multi-modal biometric authentication system that integrates facial, vocal, and signature data to enhance security measures. Utilizing a combination of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), our model architecture uniquely incorporates dual shared layers alongside modality-specific enhancements for comprehensive feature extraction. The system undergoes rigorous training with a joint loss function, optimizing for accuracy across diverse biometric inputs. Feature-level fusion via Principal Component Analysis (PCA) and classification through Gradient Boosting Machines (GBM) further refine the authentication process. Our approach demonstrates significant improvements in authentication accuracy and robustness, paving the way for advanced secure identity verification solutions.

Figures (7)

• Figure 1: Architectural Diagram
• Figure 2: Accuracy vs Epochs comparision
• Figure 3: Processing Time vs Epochs comparision
• Figure 4: Resource Utilization
• Figure 5: Error rates graph