Table of Contents
Fetching ...

Deep learning for model correction of dynamical systems with data scarcity

Caroline Tatsuoka, Dongbin Xiu

TL;DR

This paper presents a deep learning framework for correcting existing dynamical system models utilizing only a scarce high-fidelity data set and offers an inherent correction to the low-fidelity model via TL.

Abstract

We present a deep learning framework for correcting existing dynamical system models utilizing only a scarce high-fidelity data set. In many practical situations, one has a low-fidelity model that can capture the dynamics reasonably well but lacks high resolution, due to the inherent limitation of the model and the complexity of the underlying physics. When high resolution data become available, it is natural to seek model correction to improve the resolution of the model predictions. We focus on the case when the amount of high-fidelity data is so small that most of the existing data driven modeling methods cannot be applied. In this paper, we address these challenges with a model-correction method which only requires a scarce high-fidelity data set. Our method first seeks a deep neural network (DNN) model to approximate the existing low-fidelity model. By using the scarce high-fidelity data, the method then corrects the DNN model via transfer learning (TL). After TL, an improved DNN model with high prediction accuracy to the underlying dynamics is obtained. One distinct feature of the propose method is that it does not assume a specific form of the model correction terms. Instead, it offers an inherent correction to the low-fidelity model via TL. A set of numerical examples are presented to demonstrate the effectiveness of the proposed method.

Deep learning for model correction of dynamical systems with data scarcity

TL;DR

This paper presents a deep learning framework for correcting existing dynamical system models utilizing only a scarce high-fidelity data set and offers an inherent correction to the low-fidelity model via TL.

Abstract

We present a deep learning framework for correcting existing dynamical system models utilizing only a scarce high-fidelity data set. In many practical situations, one has a low-fidelity model that can capture the dynamics reasonably well but lacks high resolution, due to the inherent limitation of the model and the complexity of the underlying physics. When high resolution data become available, it is natural to seek model correction to improve the resolution of the model predictions. We focus on the case when the amount of high-fidelity data is so small that most of the existing data driven modeling methods cannot be applied. In this paper, we address these challenges with a model-correction method which only requires a scarce high-fidelity data set. Our method first seeks a deep neural network (DNN) model to approximate the existing low-fidelity model. By using the scarce high-fidelity data, the method then corrects the DNN model via transfer learning (TL). After TL, an improved DNN model with high prediction accuracy to the underlying dynamics is obtained. One distinct feature of the propose method is that it does not assume a specific form of the model correction terms. Instead, it offers an inherent correction to the low-fidelity model via TL. A set of numerical examples are presented to demonstrate the effectiveness of the proposed method.

Paper Structure

This paper contains 25 sections, 44 equations, 16 figures.

Figures (16)

  • Figure 4.1: Damped pendulum: system prediction up to $T=50$. Left: $x_1$; Right: $x_2$.
  • Figure 4.2: Damped pendulum: prediction errors up to $T=100$.
  • Figure 4.3: Duffing equation: system prediction up to $T=100$. Left: $x_1$; Right: $x_2$.
  • Figure 4.4: Duffing equation: average $l_2$ error over 100 test trajectories.
  • Figure 4.5: SEIR Model: system prediction up to $T=20$.
  • ...and 11 more figures