Correlation Analysis of Generative Models

TL;DR

A unified representation is proposed for existing diffusion models and flow matching with a neural network to predict a predefined target from noisy data using two simple linear equations in this paper.

Abstract

Based on literature review about existing diffusion models and flow matching with a neural network to predict a predefined target from noisy data, a unified representation is first proposed for these models using two simple linear equations in this paper. Theoretical analysis of the proposed model is then presented. Our theoretical analysis shows that the correlation between the noisy data and the predicted target is sometimes weak in the existing diffusion models and flow matching. This might affect the prediction (or learning) process which plays a crucial role in all models.