Table of Contents
Fetching ...

SNIC: Synthesized Noisy Images using Calibration

Nik Bhatt

TL;DR

This paper created the Synthesized Noisy Images using Calibration dataset (SNIC), containing over 6000 noisy images, comprising 30 scenes from four sensors, including two smartphone sensors, a point-and-shoot, and a DSLR, the first synthesized noisy image dataset provided in both RAW and TIFF format.

Abstract

Advanced denoising algorithms require large, high-quality datasets. Physically-based statistical noise models can create such datasets by realistically simulating noise in digital images. However, there is little information on the correct way to calibrate and tune these heteroscedastic models, and a lack of published datasets using them. In this paper, we explore the process of building high-quality heteroscedastic noise models. Our methods produce realistic synthesized noisy images in both RAW and TIFF formats. Our synthesized noisy images achieve comparable LPIPS results to real noisy images; when tested with a state-of-the-art denoising model, our images reduce the PSNR gap versus real noise by 54-64% compared to those synthesized using manufacturer-provided DNG noise models. Using our approach, we created the Synthesized Noisy Images using Calibration dataset (SNIC) containing over 6000 noisy images, comprising 30 scenes from four sensors, including two smartphone sensors, a point-and-shoot, and a DSLR. SNIC is the first synthesized noisy image dataset provided in both RAW and TIFF format.

SNIC: Synthesized Noisy Images using Calibration

TL;DR

This paper created the Synthesized Noisy Images using Calibration dataset (SNIC), containing over 6000 noisy images, comprising 30 scenes from four sensors, including two smartphone sensors, a point-and-shoot, and a DSLR, the first synthesized noisy image dataset provided in both RAW and TIFF format.

Abstract

Advanced denoising algorithms require large, high-quality datasets. Physically-based statistical noise models can create such datasets by realistically simulating noise in digital images. However, there is little information on the correct way to calibrate and tune these heteroscedastic models, and a lack of published datasets using them. In this paper, we explore the process of building high-quality heteroscedastic noise models. Our methods produce realistic synthesized noisy images in both RAW and TIFF formats. Our synthesized noisy images achieve comparable LPIPS results to real noisy images; when tested with a state-of-the-art denoising model, our images reduce the PSNR gap versus real noise by 54-64% compared to those synthesized using manufacturer-provided DNG noise models. Using our approach, we created the Synthesized Noisy Images using Calibration dataset (SNIC) containing over 6000 noisy images, comprising 30 scenes from four sensors, including two smartphone sensors, a point-and-shoot, and a DSLR. SNIC is the first synthesized noisy image dataset provided in both RAW and TIFF format.

Paper Structure

This paper contains 23 sections, 8 equations, 21 figures, 3 tables.

Figures (21)

  • Figure 1: Comparison of real camera noise (Sony A7R III) at base and high ISO versus synthetic AWGN.
  • Figure 2: Comparison of DNG Profiles. Note: Y-axis scales differ between cameras due to varying sensor characteristics. iPhone noise parameters exhibit non-linearity at high ISO values.
  • Figure 3: DNG NoiseProfile scaling term (a) for iPhone 11 Pro and iPhone 15 Pro across ISO values. Both models show unexpected non-monotonic behavior at high ISOs.
  • Figure 5: Flat-field crop (512x512 pixels) for Sony A7R III showing low variance in pixel intensity.
  • Figure 6: PTC for iPhone 11 Pro main camera
  • ...and 16 more figures