Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Let Quantum Neural Networks Choose Their Own Frequencies

Ben Jaderberg, Antonio A. Gentile, Youssef Achari Berrada, Elvira Shishenina, Vincent E. Elfving

TL;DR

The paper introduces trainable-frequency feature maps (TFFMs) for parameterized quantum circuits, allowing the generator Hamiltonian to adapt its eigenvalues and thus the model's Fourier frequencies during training. This yields TF quantum models with non-uniform spectral gaps and richer spectral representations, demonstrated through cosine-series fitting and a Navier-Stokes wake flow problem solved with differentiable quantum circuits. TF models show improved accuracy over traditional fixed-frequency (FF) models, offering a practical default approach for near-term quantum machine learning. The work suggests broader potential for TF encodings across quantum learning tasks and discusses implementation considerations and future parameterizations.

Abstract

Parameterized quantum circuits as machine learning models are typically well described by their representation as a partial Fourier series of the input features, with frequencies uniquely determined by the feature map's generator Hamiltonians. Ordinarily, these data-encoding generators are chosen in advance, fixing the space of functions that can be represented. In this work we consider a generalization of quantum models to include a set of trainable parameters in the generator, leading to a trainable frequency (TF) quantum model. We numerically demonstrate how TF models can learn generators with desirable properties for solving the task at hand, including non-regularly spaced frequencies in their spectra and flexible spectral richness. Finally, we showcase the real-world effectiveness of our approach, demonstrating an improved accuracy in solving the Navier-Stokes equations using a TF model with only a single parameter added to each encoding operation. Since TF models encompass conventional fixed frequency models, they may offer a sensible default choice for variational quantum machine learning.

Let Quantum Neural Networks Choose Their Own Frequencies

TL;DR

The paper introduces trainable-frequency feature maps (TFFMs) for parameterized quantum circuits, allowing the generator Hamiltonian to adapt its eigenvalues and thus the model's Fourier frequencies during training. This yields TF quantum models with non-uniform spectral gaps and richer spectral representations, demonstrated through cosine-series fitting and a Navier-Stokes wake flow problem solved with differentiable quantum circuits. TF models show improved accuracy over traditional fixed-frequency (FF) models, offering a practical default approach for near-term quantum machine learning. The work suggests broader potential for TF encodings across quantum learning tasks and discusses implementation considerations and future parameterizations.

Abstract

Parameterized quantum circuits as machine learning models are typically well described by their representation as a partial Fourier series of the input features, with frequencies uniquely determined by the feature map's generator Hamiltonians. Ordinarily, these data-encoding generators are chosen in advance, fixing the space of functions that can be represented. In this work we consider a generalization of quantum models to include a set of trainable parameters in the generator, leading to a trainable frequency (TF) quantum model. We numerically demonstrate how TF models can learn generators with desirable properties for solving the task at hand, including non-regularly spaced frequencies in their spectra and flexible spectral richness. Finally, we showcase the real-world effectiveness of our approach, demonstrating an improved accuracy in solving the Navier-Stokes equations using a TF model with only a single parameter added to each encoding operation. Since TF models encompass conventional fixed frequency models, they may offer a sensible default choice for variational quantum machine learning.
Paper Structure (9 sections, 16 equations, 7 figures, 2 tables)

This paper contains 9 sections, 16 equations, 7 figures, 2 tables.

Table of Contents

  1. Introduction
  2. Previous works
  3. Method
  4. Proof of principle results
  5. Application to fluid dynamics
  6. Discussion
  7. Computing derivatives of trainable parameters in the generator
  8. Quantum models and training hyperparameters
  9. Navier-Stokes results in the over-parameterized regime

Figures (7)

  • Figure 1: An overview of the concepts discussed in this paper. Top: we introduce a parameterized quantum circuit in which the generator of the data-encoding block is a function of trainable parameters $\vec{\theta}_F$, alongside the standard trainable variational ansatz. Bottom left: the output of such a model is a Fourier-like sum over different individual modes. Bottom right: in conventional quantum models, tuning the ansatz parameters $\vec{\theta}_A$ allows the coefficients of each mode to be changed. By using a trainable-frequency feature map (TFFM), tuning $\vec{\theta}_F$ leads to a quantum model in which the frequencies of each mode can also be trained.
  • Figure 2: Fitting cosine series of different frequencies using fixed-frequency (FF) and trainable-frequency (TF) QNNs. (a) Prediction after training on data with $\Omega_d=\{1, 2, 3\}$ (b) Prediction after training on data with $\Omega_d=\{1, 1.2, 3\}$. (c) Spectra of trained models in (b) as obtained using a discrete Fourier transform. The blue dashed lines indicate frequencies of the data.
  • Figure 3: Prediction MSE of simple, tower and exponential FFFMs compared to a TFFM when training on multiple data sets with equally spaced frequencies $\vec{\omega_d} \in [1, 3]$. For each box, the triangle and orange line denote the mean and median respectively.
  • Figure 4: Circuit diagram of the trainable-frequency (TF) QNN architecture used in experiments solving the Navier-Stokes equations. The trainable-frequency feature map (TFFM, dashed box) contains the generator parameters $\theta_F$ that allow training of the underlying model frequencies. The TFFM is followed by $L=8$ ansatz layers, a data-reuploading and then a final ansatz layer before the qubits are measured. Here, we study both digital and digital-analog versions of such layered abstraction.
  • Figure 5: Pressure field at $t=3.5$ of the wake flow of fluid passing a circular cylinder at x=0. Left: reference solution obtained with the finite-element method (FEM) in raissi2017physics. Cells with red borders indicate the training data accessible to the quantum models, see main text. Middle: prediction of trainable-frequency (TF) QNN using generators $\hat{G}_\theta$. Right: prediction of fixed-frequency (FF) QNN using generators $\hat{G}$. The quantum circuits are based on a sliced Digital-Analog approach (sDAQC parrarodriguez2020digitalanalog) suitable for platforms such as neutral atom quantum computers.
  • ...and 2 more figures