Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Combatting deepfakes: Policies to address national security threats and rights violations

Andrea Miotti, Akash Wasil

TL;DR

This paper tackles the rising threats of AI-generated deepfakes to individuals and global security by proposing a comprehensive supply-chain regulatory framework. It argues that accountability must extend beyond end users to include model developers, model providers, and compute providers, with explicit civil and criminal penalties and mitigations to prevent generation and distribution. The authors detail the deepfake supply chain, present concrete regulatory mechanisms at each step, and illustrate potential impacts with case scenarios while discussing counterpoints such as First Amendment concerns and watermarking limits. The work offers draft legislative text for the US and the UK and aims to reduce harms like non-consensual sexual imagery, financial fraud, and election interference while preserving beneficial AI capabilities.

Abstract

This paper provides policy recommendations to address threats from deepfakes. First, we provide background information about deepfakes and review the harms they pose. We describe how deepfakes are currently used to proliferate sexual abuse material, commit fraud, manipulate voter behavior, and pose threats to national security. Second, we review previous legislative proposals designed to address deepfakes. Third, we present a comprehensive policy proposal that focuses on addressing multiple parts of the deepfake supply chain. The deepfake supply chain begins with a small number of model developers, model providers, and compute providers, and it expands to include billions of potential deepfake creators. We describe this supply chain in greater detail and describe how entities at each step of the supply chain ought to take reasonable measures to prevent the creation and proliferation of deepfakes. Finally, we address potential counterpoints of our proposal. Overall, deepfakes will present increasingly severe threats to global security and individual liberties. To address these threats, we call on policymakers to enact legislation that addresses multiple parts of the deepfake supply chain.

Combatting deepfakes: Policies to address national security threats and rights violations

TL;DR

This paper tackles the rising threats of AI-generated deepfakes to individuals and global security by proposing a comprehensive supply-chain regulatory framework. It argues that accountability must extend beyond end users to include model developers, model providers, and compute providers, with explicit civil and criminal penalties and mitigations to prevent generation and distribution. The authors detail the deepfake supply chain, present concrete regulatory mechanisms at each step, and illustrate potential impacts with case scenarios while discussing counterpoints such as First Amendment concerns and watermarking limits. The work offers draft legislative text for the US and the UK and aims to reduce harms like non-consensual sexual imagery, financial fraud, and election interference while preserving beneficial AI capabilities.

Abstract

This paper provides policy recommendations to address threats from deepfakes. First, we provide background information about deepfakes and review the harms they pose. We describe how deepfakes are currently used to proliferate sexual abuse material, commit fraud, manipulate voter behavior, and pose threats to national security. Second, we review previous legislative proposals designed to address deepfakes. Third, we present a comprehensive policy proposal that focuses on addressing multiple parts of the deepfake supply chain. The deepfake supply chain begins with a small number of model developers, model providers, and compute providers, and it expands to include billions of potential deepfake creators. We describe this supply chain in greater detail and describe how entities at each step of the supply chain ought to take reasonable measures to prevent the creation and proliferation of deepfakes. Finally, we address potential counterpoints of our proposal. Overall, deepfakes will present increasingly severe threats to global security and individual liberties. To address these threats, we call on policymakers to enact legislation that addresses multiple parts of the deepfake supply chain.
Paper Structure (8 sections, 1 figure)

This paper contains 8 sections, 1 figure.

Table of Contents

  1. Introduction
  2. Reviewofpreviousproposalstoaddressdeepfakes
  3. Banningdeepfakes:Policyrecommendations
  4. Understandingthedeepfakesupplychain
  5. Regulationsateachstepofthesupplychain
  6. Examplescenarios
  7. Counterpointsandresponses
  8. Conclusion

Figures (1)

  • Figure 1: Representationofthedeepfakesupplychain.Thesupplychainbeginsnarrowwitharelativelysmallnumberofmodeldevelopers,modelproviders,andcomputeproviders.Attheendofthesupplychain,anextremelylargenumberofusershavethepotentialtocreatedeepfakes.