Table of Contents
Fetching ...

MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration

Tao Guo, Yinuo Wang, Shihao Shu, Weimin Yuan, Diansheng Chen, Zhouping Tang, Cai Meng, Xiangzhi Bai

TL;DR

The paper tackles cross-modality voxel-wise registration between MR and CT, a task hindered by data scarcity and high computational costs. It introduces MambaMorph, a framework that combines a Mamba-based registration module with a lightweight, fine-grained feature extractor and a contrastive learning objective, plus the SR-Reg dataset derived from SynthRAD 2023 to bolster cross-modal training. Empirical results on SR-Reg and a public T1-T2 dataset show MambaMorph achieving higher registration accuracy and favorable efficiency compared with baselines like VoxelMorph and TransMorph, attributing gains to long-range modeling with Mamba and effective feature learning. The work offers practical contributions including the SR-Reg dataset, a scalable registration module, and open-source code, advancing the applicability of multi-modality MR-CT registration in clinical workflows.

Abstract

Capturing voxel-wise spatial correspondence across distinct modalities is crucial for medical image analysis. However, current registration approaches are not practical enough in terms of registration accuracy and clinical applicability. In this paper, we introduce MambaMorph, a novel multi-modality deformable registration framework. Specifically, MambaMorph utilizes a Mamba-based registration module and a fine-grained, yet simple, feature extractor for efficient long-range correspondence modeling and high-dimensional feature learning, respectively. Additionally, we develop a well-annotated brain MR-CT registration dataset, SR-Reg, to address the scarcity of data in multi-modality registration. To validate MambaMorph's multi-modality registration capabilities, we conduct quantitative experiments on both our SR-Reg dataset and a public T1-T2 dataset. The experimental results on both datasets demonstrate that MambaMorph significantly outperforms the current state-of-the-art learning-based registration methods in terms of registration accuracy. Further study underscores the efficiency of the Mamba-based registration module and the lightweight feature extractor, which achieve notable registration quality while maintaining reasonable computational costs and speeds. We believe that MambaMorph holds significant potential for practical applications in medical image registration. The code for MambaMorph is available at: https://github.com/Guo-Stone/MambaMorph.

MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration

TL;DR

The paper tackles cross-modality voxel-wise registration between MR and CT, a task hindered by data scarcity and high computational costs. It introduces MambaMorph, a framework that combines a Mamba-based registration module with a lightweight, fine-grained feature extractor and a contrastive learning objective, plus the SR-Reg dataset derived from SynthRAD 2023 to bolster cross-modal training. Empirical results on SR-Reg and a public T1-T2 dataset show MambaMorph achieving higher registration accuracy and favorable efficiency compared with baselines like VoxelMorph and TransMorph, attributing gains to long-range modeling with Mamba and effective feature learning. The work offers practical contributions including the SR-Reg dataset, a scalable registration module, and open-source code, advancing the applicability of multi-modality MR-CT registration in clinical workflows.

Abstract

Capturing voxel-wise spatial correspondence across distinct modalities is crucial for medical image analysis. However, current registration approaches are not practical enough in terms of registration accuracy and clinical applicability. In this paper, we introduce MambaMorph, a novel multi-modality deformable registration framework. Specifically, MambaMorph utilizes a Mamba-based registration module and a fine-grained, yet simple, feature extractor for efficient long-range correspondence modeling and high-dimensional feature learning, respectively. Additionally, we develop a well-annotated brain MR-CT registration dataset, SR-Reg, to address the scarcity of data in multi-modality registration. To validate MambaMorph's multi-modality registration capabilities, we conduct quantitative experiments on both our SR-Reg dataset and a public T1-T2 dataset. The experimental results on both datasets demonstrate that MambaMorph significantly outperforms the current state-of-the-art learning-based registration methods in terms of registration accuracy. Further study underscores the efficiency of the Mamba-based registration module and the lightweight feature extractor, which achieve notable registration quality while maintaining reasonable computational costs and speeds. We believe that MambaMorph holds significant potential for practical applications in medical image registration. The code for MambaMorph is available at: https://github.com/Guo-Stone/MambaMorph.
Paper Structure (17 sections, 1 equation, 2 figures, 2 tables)

This paper contains 17 sections, 1 equation, 2 figures, 2 tables.

Figures (2)

  • Figure 1: The framework of MambaMorph
  • Figure 2: SR-Reg Dataset. The three columns of samples are MR, CT and their corresponding segmentation respectively. Notably, volumes from each row are from the same subject.