Table of Contents
Fetching ...

Striving for Faster and Better: A One-Layer Architecture with Auto Re-parameterization for Low-Light Image Enhancement

Nan An, Long Ma, Guangchao Han, Xin Fan, RIsheng Liu

TL;DR

This paper addresses the challenge of achieving high-quality low-light image enhancement with real-time efficiency by proposing AR-LLIE, a one-layer CNN augmented with auto re-parameterization and guided by tiered neural architecture search. By learning a rich multi-branch representation during training and collapsing it into a single 3×3 convolution at inference, the method delivers state-of-the-art visual quality while maintaining exceptional speed on CPU, GPU, DSP, and NPU. The authors introduce a formal loss framework combining fidelity and spatial smoothing, and validate the approach across multiple datasets (MIT, LOL, DARKFACE, BAID) with extensive ablations and a downstream detection study showing practical benefits. The work demonstrates that task-aware re-parameterization, when coupled with structured architecture search, can push the limits of efficiency without sacrificing perceptual quality, and provides evidence of broad applicability in real-time imaging systems.

Abstract

Deep learning-based low-light image enhancers have made significant progress in recent years, with a trend towards achieving satisfactory visual quality while gradually reducing the number of parameters and improving computational efficiency. In this work, we aim to delving into the limits of image enhancers both from visual quality and computational efficiency, while striving for both better performance and faster processing. To be concrete, by rethinking the task demands, we build an explicit connection, i.e., visual quality and computational efficiency are corresponding to model learning and structure design, respectively. Around this connection, we enlarge parameter space by introducing the re-parameterization for ample model learning of a pre-defined minimalist network (e.g., just one layer), to avoid falling into a local solution. To strengthen the structural representation, we define a hierarchical search scheme for discovering a task-oriented re-parameterized structure, which also provides powerful support for efficiency. Ultimately, this achieves efficient low-light image enhancement using only a single convolutional layer, while maintaining excellent visual quality. Experimental results show our sensible superiority both in quality and efficiency against recently-proposed methods. Especially, our running time on various platforms (e.g., CPU, GPU, NPU, DSP) consistently moves beyond the existing fastest scheme. The source code will be released at https://github.com/vis-opt-group/AR-LLIE.

Striving for Faster and Better: A One-Layer Architecture with Auto Re-parameterization for Low-Light Image Enhancement

TL;DR

This paper addresses the challenge of achieving high-quality low-light image enhancement with real-time efficiency by proposing AR-LLIE, a one-layer CNN augmented with auto re-parameterization and guided by tiered neural architecture search. By learning a rich multi-branch representation during training and collapsing it into a single 3×3 convolution at inference, the method delivers state-of-the-art visual quality while maintaining exceptional speed on CPU, GPU, DSP, and NPU. The authors introduce a formal loss framework combining fidelity and spatial smoothing, and validate the approach across multiple datasets (MIT, LOL, DARKFACE, BAID) with extensive ablations and a downstream detection study showing practical benefits. The work demonstrates that task-aware re-parameterization, when coupled with structured architecture search, can push the limits of efficiency without sacrificing perceptual quality, and provides evidence of broad applicability in real-time imaging systems.

Abstract

Deep learning-based low-light image enhancers have made significant progress in recent years, with a trend towards achieving satisfactory visual quality while gradually reducing the number of parameters and improving computational efficiency. In this work, we aim to delving into the limits of image enhancers both from visual quality and computational efficiency, while striving for both better performance and faster processing. To be concrete, by rethinking the task demands, we build an explicit connection, i.e., visual quality and computational efficiency are corresponding to model learning and structure design, respectively. Around this connection, we enlarge parameter space by introducing the re-parameterization for ample model learning of a pre-defined minimalist network (e.g., just one layer), to avoid falling into a local solution. To strengthen the structural representation, we define a hierarchical search scheme for discovering a task-oriented re-parameterized structure, which also provides powerful support for efficiency. Ultimately, this achieves efficient low-light image enhancement using only a single convolutional layer, while maintaining excellent visual quality. Experimental results show our sensible superiority both in quality and efficiency against recently-proposed methods. Especially, our running time on various platforms (e.g., CPU, GPU, NPU, DSP) consistently moves beyond the existing fastest scheme. The source code will be released at https://github.com/vis-opt-group/AR-LLIE.

Paper Structure

This paper contains 24 sections, 5 equations, 17 figures, 9 tables, 1 algorithm.

Figures (17)

  • Figure 1: Performance evaluations among our AR-LLIE and three recent state-of-the-art representative low-light image enhancement approaches (ZeroIG shi2024zero, RUAS liu2022learning, and SCI ma2022toward). By evaluating the average running time of images with the size of 1920$\times$1080 on various computational platforms (CPU and GPU for PC, NPU and DSP for mobile) in (a), our AR-LLIE shows the consistently fastest time on all platforms. The visual comparisons of different scenarios in (b) further show the superior visual quality generated by our AR-LLIE.
  • Figure 2: The overall framework of the our AR-LLIE.
  • Figure 3: Qualitative comparison with advanced methods of low-light image enhancement on the MIT dataset.
  • Figure 4: Qualitative comparison with advanced methods of low-light image enhancement on samples with significant noise in LOL dataset.
  • Figure 5: Qualitative comparison with advanced methods of low-light image enhancement on the DARKFACE dataset.
  • ...and 12 more figures