Table of Contents
Fetching ...

Regional Attention for Shadow Removal

Hengxing Liu, Mingjia Li, Xiaojie Guo

TL;DR

A Regional Attention Shadow Removal Model (RASM), which leverages non-shadow areas to assist in restoring shadow ones and allows each shadow region to interact more rationally with its surrounding non-shadow areas, for seeking the regional contextual correlation between shadow and non-shadow areas.

Abstract

Shadow, as a natural consequence of light interacting with objects, plays a crucial role in shaping the aesthetics of an image, which however also impairs the content visibility and overall visual quality. Recent shadow removal approaches employ the mechanism of attention, due to its effectiveness, as a key component. However, they often suffer from two issues including large model size and high computational complexity for practical use. To address these shortcomings, this work devises a lightweight yet accurate shadow removal framework. First, we analyze the characteristics of the shadow removal task to seek the key information required for reconstructing shadow regions and designing a novel regional attention mechanism to effectively capture such information. Then, we customize a Regional Attention Shadow Removal Model (RASM, in short), which leverages non-shadow areas to assist in restoring shadow ones. Unlike existing attention-based models, our regional attention strategy allows each shadow region to interact more rationally with its surrounding non-shadow areas, for seeking the regional contextual correlation between shadow and non-shadow areas. Extensive experiments are conducted to demonstrate that our proposed method delivers superior performance over other state-of-the-art models in terms of accuracy and efficiency, making it appealing for practical applications.

Regional Attention for Shadow Removal

TL;DR

A Regional Attention Shadow Removal Model (RASM), which leverages non-shadow areas to assist in restoring shadow ones and allows each shadow region to interact more rationally with its surrounding non-shadow areas, for seeking the regional contextual correlation between shadow and non-shadow areas.

Abstract

Shadow, as a natural consequence of light interacting with objects, plays a crucial role in shaping the aesthetics of an image, which however also impairs the content visibility and overall visual quality. Recent shadow removal approaches employ the mechanism of attention, due to its effectiveness, as a key component. However, they often suffer from two issues including large model size and high computational complexity for practical use. To address these shortcomings, this work devises a lightweight yet accurate shadow removal framework. First, we analyze the characteristics of the shadow removal task to seek the key information required for reconstructing shadow regions and designing a novel regional attention mechanism to effectively capture such information. Then, we customize a Regional Attention Shadow Removal Model (RASM, in short), which leverages non-shadow areas to assist in restoring shadow ones. Unlike existing attention-based models, our regional attention strategy allows each shadow region to interact more rationally with its surrounding non-shadow areas, for seeking the regional contextual correlation between shadow and non-shadow areas. Extensive experiments are conducted to demonstrate that our proposed method delivers superior performance over other state-of-the-art models in terms of accuracy and efficiency, making it appealing for practical applications.

Paper Structure

This paper contains 16 sections, 10 equations, 5 figures, 5 tables.

Figures (5)

  • Figure 1: An illustration of our proposed framework. (a) Overview of the RASM structure. (b) Channel Attention Module. (c) Regional Attention Module. RASM employs the Channel Attention Module for global information interaction, followed by a Regional Attention Module for spatial information interaction.
  • Figure 2: The first column of images presents scenes with shadows. The highlighted regions in the second column of images represent the non-shadowed areas immediately adjacent to the shadows. We posit that the information from these areas is crucial for the task of shadow removal.
  • Figure 3: Qualitative comparison on ISTD+ dataset. Please zoom in for more details.
  • Figure 4: Qualitative comparison on SRD dataset. Please zoom in for more details.
  • Figure 5: A visualization of our regional attention. The original image is on the left, and the star marks the selected points. The heatmaps indicate the regional attention weight of the marked tokens. Brighter colors indicate a larger attention score.