A General Model for Deepfake Speech Detection: Diverse Bonafide Resources or Diverse AI-Based Generators

Abstract

In this paper, we analyze two main factors of Bonafide Resource (BR) or AI-based Generator (AG) which affect the performance and the generality of a Deepfake Speech Detection (DSD) model. To this end, we first propose a deep-learning based model, referred to as the baseline. Then, we conducted experiments on the baseline by which we indicate how Bonafide Resource (BR) and AI-based Generator (AG) factors affect the threshold score used to detect fake or bonafide input audio in the inference process. Given the experimental results, a dataset, which re-uses public Deepfake Speech Detection (DSD) datasets and shows a balance between Bonafide Resource (BR) or AI-based Generator (AG), is proposed. We then train various deep-learning based models on the proposed dataset and conduct cross-dataset evaluation on different benchmark datasets. The cross-dataset evaluation results prove that the balance of Bonafide Resources (BR) and AI-based Generators (AG) is the key factor to train and achieve a general Deepfake Speech Detection (DSD) model.

Figures (11)

• Figure 1: The proposed baseline architecture
• Figure 2: The statistics of DSD datasets in English
• Figure 3: Distribution of fake probabilities from In-The-Wild dataset using AG dataset to train the baseline model
• Figure 4: Distribution of Logarit scores from In-The-Wild dataset using AG dataset to train the baseline model
• Figure 5: Distribution of fake probabilities from In-The-Wild dataset using BR dataset to train the baseline model