Table of Contents
Fetching ...

Differentiable All-pole Filters for Time-varying Audio Systems

Chin-Yun Yu, Christopher Mitcheltree, Alistair Carson, Stefan Bilbao, Joshua D. Reiss, György Fazekas

TL;DR

This work re-expresses a time-varying all-pole filter to backpropagate the gradients through itself, so the filter implementation is not bound to the technical limitations of automatic differentiation frameworks and can be employed within audio systems containing filters with poles for efficient gradient evaluation.

Abstract

Infinite impulse response filters are an essential building block of many time-varying audio systems, such as audio effects and synthesisers. However, their recursive structure impedes end-to-end training of these systems using automatic differentiation. Although non-recursive filter approximations like frequency sampling and frame-based processing have been proposed and widely used in previous works, they cannot accurately reflect the gradient of the original system. We alleviate this difficulty by re-expressing a time-varying all-pole filter to backpropagate the gradients through itself, so the filter implementation is not bound to the technical limitations of automatic differentiation frameworks. This implementation can be employed within audio systems containing filters with poles for efficient gradient evaluation. We demonstrate its training efficiency and expressive capabilities for modelling real-world dynamic audio systems on a phaser, time-varying subtractive synthesiser, and compressor. We make our code and audio samples available and provide the trained audio effect and synth models in a VST plugin at https://diffapf.github.io/web/.

Differentiable All-pole Filters for Time-varying Audio Systems

TL;DR

This work re-expresses a time-varying all-pole filter to backpropagate the gradients through itself, so the filter implementation is not bound to the technical limitations of automatic differentiation frameworks and can be employed within audio systems containing filters with poles for efficient gradient evaluation.

Abstract

Infinite impulse response filters are an essential building block of many time-varying audio systems, such as audio effects and synthesisers. However, their recursive structure impedes end-to-end training of these systems using automatic differentiation. Although non-recursive filter approximations like frequency sampling and frame-based processing have been proposed and widely used in previous works, they cannot accurately reflect the gradient of the original system. We alleviate this difficulty by re-expressing a time-varying all-pole filter to backpropagate the gradients through itself, so the filter implementation is not bound to the technical limitations of automatic differentiation frameworks. This implementation can be employed within audio systems containing filters with poles for efficient gradient evaluation. We demonstrate its training efficiency and expressive capabilities for modelling real-world dynamic audio systems on a phaser, time-varying subtractive synthesiser, and compressor. We make our code and audio samples available and provide the trained audio effect and synth models in a VST plugin at https://diffapf.github.io/web/.
Paper Structure (17 sections, 18 equations, 3 figures, 7 tables, 1 algorithm)

This paper contains 17 sections, 18 equations, 3 figures, 7 tables, 1 algorithm.

Figures (3)

  • Figure 1: The forward (left) and backpropagation (right) flow chart of a third-order time-varying all-pole filter.
  • Figure 2: Discrete-time phaser model considered in this work, where $K=4$. APF represents a time-varying all-pass filter with difference equation \ref{['eq:apf']} and BQ is a biquad filter.
  • Figure 3: Diagram of the differentiable synth modelling process. Our time domain filter component is shown in green.