Table of Contents
Fetching ...

UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation

Hongshen Zhao, Jingkang Tai, Yuhang Wu, Wenkang Zhang, Xi Lan, Shangyan Wang, Tianyu Zhang, Wankou Yang

Abstract

Underwater Video Object Segmentation (VOS) is essential for marine exploration, yet open-air methods suffer significant degradation due to color distortion, low contrast, and prevalent camouflage. A primary hurdle is the lack of high-quality training data. To bridge this gap, we introduce $\textbf{UW-VOS}$, the first large-scale underwater VOS benchmark comprising 1,431 video sequences across 409 categories with 309,295 mask annotations, constructed via a semi-automatic data engine with rigorous human verification. We further propose $\textbf{SAM-U}$, a parameter-efficient framework that adapts SAM2 to the underwater domain. By inserting lightweight adapters into the image encoder, SAM-U achieves state-of-the-art performance with only $\sim$2$\%$ trainable parameters. Extensive experiments reveal that existing methods experience an average 13-point $\mathcal{J}\&\mathcal{F}$ drop on UW-VOS, while SAM-U effectively bridges this domain gap. Detailed attribute-based analysis further identifies small targets, camouflage, and exit-re-entry as critical bottlenecks, providing a roadmap for future research in robust underwater perception.

UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation

Abstract

Underwater Video Object Segmentation (VOS) is essential for marine exploration, yet open-air methods suffer significant degradation due to color distortion, low contrast, and prevalent camouflage. A primary hurdle is the lack of high-quality training data. To bridge this gap, we introduce , the first large-scale underwater VOS benchmark comprising 1,431 video sequences across 409 categories with 309,295 mask annotations, constructed via a semi-automatic data engine with rigorous human verification. We further propose , a parameter-efficient framework that adapts SAM2 to the underwater domain. By inserting lightweight adapters into the image encoder, SAM-U achieves state-of-the-art performance with only 2 trainable parameters. Extensive experiments reveal that existing methods experience an average 13-point drop on UW-VOS, while SAM-U effectively bridges this domain gap. Detailed attribute-based analysis further identifies small targets, camouflage, and exit-re-entry as critical bottlenecks, providing a roadmap for future research in robust underwater perception.
Paper Structure (24 sections, 2 equations, 11 figures, 7 tables)

This paper contains 24 sections, 2 equations, 11 figures, 7 tables.

Figures (11)

  • Figure 1: Example videos from the proposed UW-VOS dataset. The selected targets are highlighted by colored masks. The figure illustrates several representative characteristics in the UW-VOS dataset, including complex interactions among multiple targets (a), small objects within similar clusters (b, c), turbid water conditions (d), camouflaged targets (e), target exit and re-entry (f), complex lighting and shadows (g), as well as viewpoint changes (h).
  • Figure 2: Overview of the semi-automatic data engine designed for constructing the UW-VOS dataset. The final annotations have undergone multiple rounds of manual verification (highlighted in light blue).
  • Figure 3: Category-instance distribution of the UW-VOS dataset. Due to space constraints, we only visualize the top 10 subcategories within each superclass.
  • Figure 4: Video length distribution across diverse frame-count ranges.
  • Figure 5: Mask size distribution, normalized by video resolution.
  • ...and 6 more figures