Table of Contents
Fetching ...

Occlusion-aware Non-Rigid Point Cloud Registration via Unsupervised Neural Deformation Correntropy

Mingyang Zhao, Gaofeng Meng, Dong-Ming Yan

TL;DR

The paper addresses non-rigid point cloud registration under occlusion by introducing Occlusion-Aware Registration (OAR), which jointly optimizes an implicit deformation field with a maximum correntropy criterion (MCC) and a Locally Linear Reconstruction (LLR) prior. By using MCC with a Gaussian kernel, the approach provides adaptive, per-point similarity that downweights occluded regions, while LLR enforces physically plausible deformations in areas without correspondences; an explicit relationship between MCC and Chamfer distance is established to highlight MCC’s broader applicability. The method is unsupervised, end-to-end, and relies on a coordinate-based MLP for deformation along with closed-form LLR weights, achieving superior or competitive results across occluded datasets (liver, TOSCA), 4DMatch/4DLoMatch, RGB-D human data, and applications to shape interpolation and completion. This has practical impact for robust 3D scene understanding, medical imaging, and robotics tasks where partial visibility and large deformations are common.

Abstract

Non-rigid alignment of point clouds is crucial for scene understanding, reconstruction, and various computer vision and robotics tasks. Recent advancements in implicit deformation networks for non-rigid registration have significantly reduced the reliance on large amounts of annotated training data. However, existing state-of-the-art methods still face challenges in handling occlusion scenarios. To address this issue, this paper introduces an innovative unsupervised method called Occlusion-Aware Registration (OAR) for non-rigidly aligning point clouds. The key innovation of our method lies in the utilization of the adaptive correntropy function as a localized similarity measure, enabling us to treat individual points distinctly. In contrast to previous approaches that solely minimize overall deviations between two shapes, we combine unsupervised implicit neural representations with the maximum correntropy criterion to optimize the deformation of unoccluded regions. This effectively avoids collapsed, tearing, and other physically implausible results. Moreover, we present a theoretical analysis and establish the relationship between the maximum correntropy criterion and the commonly used Chamfer distance, highlighting that the correntropy-induced metric can be served as a more universal measure for point cloud analysis. Additionally, we introduce locally linear reconstruction to ensure that regions lacking correspondences between shapes still undergo physically natural deformations. Our method achieves superior or competitive performance compared to existing approaches, particularly when dealing with occluded geometries. We also demonstrate the versatility of our method in challenging tasks such as large deformations, shape interpolation, and shape completion under occlusion disturbances.

Occlusion-aware Non-Rigid Point Cloud Registration via Unsupervised Neural Deformation Correntropy

TL;DR

The paper addresses non-rigid point cloud registration under occlusion by introducing Occlusion-Aware Registration (OAR), which jointly optimizes an implicit deformation field with a maximum correntropy criterion (MCC) and a Locally Linear Reconstruction (LLR) prior. By using MCC with a Gaussian kernel, the approach provides adaptive, per-point similarity that downweights occluded regions, while LLR enforces physically plausible deformations in areas without correspondences; an explicit relationship between MCC and Chamfer distance is established to highlight MCC’s broader applicability. The method is unsupervised, end-to-end, and relies on a coordinate-based MLP for deformation along with closed-form LLR weights, achieving superior or competitive results across occluded datasets (liver, TOSCA), 4DMatch/4DLoMatch, RGB-D human data, and applications to shape interpolation and completion. This has practical impact for robust 3D scene understanding, medical imaging, and robotics tasks where partial visibility and large deformations are common.

Abstract

Non-rigid alignment of point clouds is crucial for scene understanding, reconstruction, and various computer vision and robotics tasks. Recent advancements in implicit deformation networks for non-rigid registration have significantly reduced the reliance on large amounts of annotated training data. However, existing state-of-the-art methods still face challenges in handling occlusion scenarios. To address this issue, this paper introduces an innovative unsupervised method called Occlusion-Aware Registration (OAR) for non-rigidly aligning point clouds. The key innovation of our method lies in the utilization of the adaptive correntropy function as a localized similarity measure, enabling us to treat individual points distinctly. In contrast to previous approaches that solely minimize overall deviations between two shapes, we combine unsupervised implicit neural representations with the maximum correntropy criterion to optimize the deformation of unoccluded regions. This effectively avoids collapsed, tearing, and other physically implausible results. Moreover, we present a theoretical analysis and establish the relationship between the maximum correntropy criterion and the commonly used Chamfer distance, highlighting that the correntropy-induced metric can be served as a more universal measure for point cloud analysis. Additionally, we introduce locally linear reconstruction to ensure that regions lacking correspondences between shapes still undergo physically natural deformations. Our method achieves superior or competitive performance compared to existing approaches, particularly when dealing with occluded geometries. We also demonstrate the versatility of our method in challenging tasks such as large deformations, shape interpolation, and shape completion under occlusion disturbances.

Paper Structure

This paper contains 43 sections, 2 theorems, 20 equations, 20 figures, 7 tables.

Key Result

Lemma 1

[liu2007correntropy] $\mathcal{M}(\bm{x}, \bm{y})$ is equivalent to the $\ell_2$ metric if $\bm{x}, \bm{y}$ are close, behaves similarly to the $\ell_1$ metric as $\bm{x}, \bm{y}$ get apart and approaches the $\ell_0$ when they are far apart.

Figures (20)

  • Figure 1: Non-rigid registration of point clouds under occlusion disturbances. The pre-operative liver (complete) and the intra-operative liver (occluded) serve as the source and target models, respectively. While competing approaches produce physically implausible results like collapses and tearing, our method achieves successful registrations (top) while faithfully preserving the physical structure (bottom) such as the blood vessel present in the source liver.
  • Figure 2: Geometric meaning of locally linear reconstruction. Left: The initial source shape along with the reconstruction weight vector $\bm{w}_j$. Right: The deformed shape reconstructed using the same $\bm{w}_j$.
  • Figure 3: Qualitative comparison on different types of occlusion. We register the complete source cat and dog model to the target shape with body and tail occlusion, respectively.
  • Figure 4: Qualitative comparison of AIAP and LLR with increasing occlusion. As observed, LLR enables more natural registration results and maintains geometric details such as the facial expression more faithfully.
  • Figure 5: Ablation study of the LLR effect and the comparison between AIAP and LLR manners.
  • ...and 15 more figures

Theorems & Definitions (4)

  • Definition 1: santamaria2006generalizedliu2007correntropy
  • Definition 2: liu2007correntropy
  • Lemma 1
  • Proposition 1