Table of Contents
Fetching ...

Grey-informed neural network for time-series forecasting

Wanli Xie, Ruibin Zhao, Zhenguo Xu, Tingting Liang

TL;DR

The paper tackles time-series forecasting under limited data by embedding grey-system laws into neural networks to improve interpretability and data efficiency. It introduces the Grey-Informed Neural Network (GINN) with a dual loss $L^{ALL}(\theta)=L^{NN}(\theta)+\xi L^{GM}(\theta)$, and extends it to a fractional variant FGINN using truncated M-fractional operators to form the $tM$-fractional Grey Model framework. Empirical results on multiple datasets show that FGINN often yields superior accuracy (lower $MAPE$, $MSE$, $MAE$, $RMSE$) compared to GINN and classical baselines, especially in small-sample regimes. The approach blends neural network flexibility with grey-system determinism, offering interpretable and accurate forecasts for multivariate time series such as regional electricity consumption.

Abstract

Neural network models have shown outstanding performance and successful resolutions to complex problems in various fields. However, the majority of these models are viewed as black-box, requiring a significant amount of data for development. Consequently, in situations with limited data, constructing appropriate models becomes challenging due to the lack of transparency and scarcity of data. To tackle these challenges, this study suggests the implementation of a grey-informed neural network (GINN). The GINN ensures that the output of the neural network follows the differential equation model of the grey system, improving interpretability. Moreover, incorporating prior knowledge from grey system theory enables traditional neural networks to effectively handle small data samples. Our proposed model has been observed to uncover underlying patterns in the real world and produce reliable forecasts based on empirical data.

Grey-informed neural network for time-series forecasting

TL;DR

The paper tackles time-series forecasting under limited data by embedding grey-system laws into neural networks to improve interpretability and data efficiency. It introduces the Grey-Informed Neural Network (GINN) with a dual loss , and extends it to a fractional variant FGINN using truncated M-fractional operators to form the -fractional Grey Model framework. Empirical results on multiple datasets show that FGINN often yields superior accuracy (lower , , , ) compared to GINN and classical baselines, especially in small-sample regimes. The approach blends neural network flexibility with grey-system determinism, offering interpretable and accurate forecasts for multivariate time series such as regional electricity consumption.

Abstract

Neural network models have shown outstanding performance and successful resolutions to complex problems in various fields. However, the majority of these models are viewed as black-box, requiring a significant amount of data for development. Consequently, in situations with limited data, constructing appropriate models becomes challenging due to the lack of transparency and scarcity of data. To tackle these challenges, this study suggests the implementation of a grey-informed neural network (GINN). The GINN ensures that the output of the neural network follows the differential equation model of the grey system, improving interpretability. Moreover, incorporating prior knowledge from grey system theory enables traditional neural networks to effectively handle small data samples. Our proposed model has been observed to uncover underlying patterns in the real world and produce reliable forecasts based on empirical data.
Paper Structure (11 sections, 4 theorems, 45 equations, 4 figures, 3 tables, 1 algorithm)

This paper contains 11 sections, 4 theorems, 45 equations, 4 figures, 3 tables, 1 algorithm.

Key Result

Theorem 1

If f is differentiable and $x>0$, then where $\Gamma(\cdot)$ is the Gamma function.

Figures (4)

  • Figure 1: The relationship between the white system, grey system, and black system is intrinsically linked to the quantity of available data. When full knowledge of a system is attained, data collection becomes unnecessary to understand its operational principles. However, when only partial information is available, a grey system is required to detail the operational rules of the system.
  • Figure 2: Schematic diagram of the network structure of GINN. The error in the proposed neural network model can be divided into two components. The first component stems from the disparity between the predicted values and the actual values within the neural network. The second component pertains to the error within the grey system model.
  • Figure 3: Framework of main research content: a comprehensive analysis.
  • Figure 4: An illustration of each point error for all models is shown in a box plot. These include "M1", "M2", "M3", "M4", "M5", "M6", "M7", and "M8" which represent FGINN, GINN, MLP, CFGM, FGM, FHGM, GM, and DGM, respectively.

Theorems & Definitions (18)

  • Definition 1: vanterler2018new
  • Definition 2: vanterler2018new
  • Theorem 1: vanterler2018new
  • Definition 3: vanterler2018new
  • Definition 4
  • Definition 5
  • Definition 6
  • Definition 7
  • Lemma 1: Bainov1992
  • Definition 8
  • ...and 8 more