Table of Contents
Fetching ...

MVMS-RCN: A Dual-Domain Unfolding CT Reconstruction with Multi-sparse-view and Multi-scale Refinement-correction

Xiaohong Fan, Ke Chen, Huaming Yi, Yin Yang, Jianping Zhang

TL;DR

A novel dual-domain deep unfolding unified framework that offers a great deal of flexibility for multi-sparse-view CT reconstruction with different sampling views through a single model is proposed that combines the theoretical advantages of model-based methods with the superior reconstruction performance of DL-based methods, resulting in the expected generalizability of DL.

Abstract

X-ray Computed Tomography (CT) is one of the most important diagnostic imaging techniques in clinical applications. Sparse-view CT imaging reduces the number of projection views to a lower radiation dose and alleviates the potential risk of radiation exposure. Most existing deep learning (DL) and deep unfolding sparse-view CT reconstruction methods: 1) do not fully use the projection data; 2) do not always link their architecture designs to a mathematical theory; 3) do not flexibly deal with multi-sparse-view reconstruction assignments. This paper aims to use mathematical ideas and design optimal DL imaging algorithms for sparse-view tomography reconstructions. We propose a novel dual-domain deep unfolding unified framework that offers a great deal of flexibility for multi-sparse-view CT reconstruction with different sampling views through a single model. This framework combines the theoretical advantages of model-based methods with the superior reconstruction performance of DL-based methods, resulting in the expected generalizability of DL. We propose a refinement module that utilizes unfolding projection domain to refine full-sparse-view projection errors, as well as an image domain correction module that distills multi-scale geometric error corrections to reconstruct sparse-view CT. This provides us with a new way to explore the potential of projection information and a new perspective on designing network architectures. All parameters of our proposed framework are learnable end to end, and our method possesses the potential to be applied to plug-and-play reconstruction. Extensive experiments demonstrate that our framework is superior to other existing state-of-the-art methods. Our source codes are available at https://github.com/fanxiaohong/MVMS-RCN.

MVMS-RCN: A Dual-Domain Unfolding CT Reconstruction with Multi-sparse-view and Multi-scale Refinement-correction

TL;DR

A novel dual-domain deep unfolding unified framework that offers a great deal of flexibility for multi-sparse-view CT reconstruction with different sampling views through a single model is proposed that combines the theoretical advantages of model-based methods with the superior reconstruction performance of DL-based methods, resulting in the expected generalizability of DL.

Abstract

X-ray Computed Tomography (CT) is one of the most important diagnostic imaging techniques in clinical applications. Sparse-view CT imaging reduces the number of projection views to a lower radiation dose and alleviates the potential risk of radiation exposure. Most existing deep learning (DL) and deep unfolding sparse-view CT reconstruction methods: 1) do not fully use the projection data; 2) do not always link their architecture designs to a mathematical theory; 3) do not flexibly deal with multi-sparse-view reconstruction assignments. This paper aims to use mathematical ideas and design optimal DL imaging algorithms for sparse-view tomography reconstructions. We propose a novel dual-domain deep unfolding unified framework that offers a great deal of flexibility for multi-sparse-view CT reconstruction with different sampling views through a single model. This framework combines the theoretical advantages of model-based methods with the superior reconstruction performance of DL-based methods, resulting in the expected generalizability of DL. We propose a refinement module that utilizes unfolding projection domain to refine full-sparse-view projection errors, as well as an image domain correction module that distills multi-scale geometric error corrections to reconstruct sparse-view CT. This provides us with a new way to explore the potential of projection information and a new perspective on designing network architectures. All parameters of our proposed framework are learnable end to end, and our method possesses the potential to be applied to plug-and-play reconstruction. Extensive experiments demonstrate that our framework is superior to other existing state-of-the-art methods. Our source codes are available at https://github.com/fanxiaohong/MVMS-RCN.
Paper Structure (23 sections, 24 equations, 6 figures, 7 tables, 1 algorithm)

This paper contains 23 sections, 24 equations, 6 figures, 7 tables, 1 algorithm.

Figures (6)

  • Figure 1: The overall architecture of the proposed unified dual-domain multi-sparse-view CT reconstruction framework (MVMS-RCN). It consists of multi-view projection refinement module $\mathcal{R}$ and multi-scale geometric correction module $\mathcal{D}$.
  • Figure 2: Boxplots of RMSE (HU) values of different methods for (a) fan-beam projection with 32 views and (b) parallel-beam projection with 60 views.
  • Figure 3: The axial reconstruction results ('1' and '3') and corresponding residuals ('2' and '4') from different methods for fan-beam projection with 32 views. (a1),(a3) reference image, (b1)-(b4) FBP, (c1)-(c4) RED-CNN, (d1)-(d4) FBPConvNet, (e1)-(e4) Uformer, (f1)-(f4) PD-Net, (g1)-(g4) ISTA-Net, (h1)-(h4) ISTA-Net+, (i1)-(i4) FISTA-Net, (j1)-(j4) Nest-DGIL, (k1)-(k4) DPIR, (l1)-(l4) MVMS-RCN. The display windows are [-1150, 350] HU and [-160, 240] HU, respectively.
  • Figure 4: The axial reconstruction results from different methods for parallel-beam projection with 60 views. (a1)-(a2) reference image, (b1)-(b2) FBP, (c1)-(c2) RED-CNN, (d1)-(d2) FBPConvNet, (e1)-(e2) Uformer, (f1)-(f2) PD-Net, (g1)-(g2) ISTA-Net, (h1)-(h2) ISTA-Net+, (i1)-(i2) FISTA-Net, (j1)-(j2) Nest-DGIL, (k1)-(k2) DPIR, (l1)-(l2) MVMS-RCN. The display windows are [-1150, 350] HU and [-160, 240] HU, respectively.
  • Figure 5: The convergence curve for the reconstruction of the perturbed projection data in a fan-beam projection with 32 views.
  • ...and 1 more figures