pipette
ESEspañol

SonarVoxNet: Diver Detection in 3D Bounding Box using 3D Sonar

Eugene Park, Jiwon Lee, Seyoung Kan, Trung Dong, Xiaomin Lin, Jane Shin

PreprintClaims a big stepReal-world use

In the authors' words

Autonomous underwater vehicles (AUVs) assisting human divers must continuously track not only the diver's 3D position but also their full-body orientation. However, vision-based perception is unreliable underwater, and forward-looking sonar -- despite being widely used -- discards the elevation information needed for orientation estimation, posing a fundamental limitation. Recently commercialized 3D sonar preserves elevation but produces sparse, noisy returns, and existing detectors are built for dense LiDAR data and for targets that remain upright and rotate only about the yaw axis (e.g., vehicles, pedestrians), making them unable to represent a freely pitching and rolling diver. To address this gap, we present two contributions. First, SonarVoxNet adapts a voxel-based encoder and an anchor-free center-based detection head to 3D sonar data, replacing the conventional yaw-only rotation representation with a continuous 6D rotation parameterization to predict full 9-DoF oriented bounding boxes -- to our knowledge, the first 3D sonar diver detector to do so. Second, Diver3D is the first public 3D sonar dataset with full 3D orientation labels for divers in diverse, non-upright poses, collected at a natural cave-diving site. Through controlled ablations over the backbone and detection head, we show that the dominant factor behind accurate 3D sonar-based diver detection is the transition from yaw-only rotation to full-SO(3) rotation. This transition substantially improves detection accuracy and reduces orientation error. These results demonstrate that full-body diver orientation is recoverable from 3D sonar alone, laying the groundwork for future work on diver pose estimation and diver-robot interaction.

Main resultThe abstract does not state a limitation.

In plain words AI summary

Autonomous underwater vehicles need to track where divers are and which way their bodies point. Cameras work poorly underwater, and regular sonar loses the up-down angle needed to know body tilt. New 3D sonar keeps this angle but gives sparse, noisy data, and existing tools only handle upright objects. The authors built SonarVoxNet, which adapts existing methods to 3D sonar and tracks divers in any body position. They also created Diver3D, the first public dataset of 3D sonar images showing divers in varied poses with full orientation labels. Tests showed that allowing full rotation instead of just left-right turning greatly improves detection and reduces orientation error. The results suggest that 3D sonar alone can recover full body orientation, enabling future work on diver pose and robot interaction.

Written by Kimi K2.5 using only the abstract above. Jev checked that every sentence is supported by the abstract sentences it cites, and removed any that were not. Point at a sentence to highlight its source.

Appeared: Friday, October 2. arXiv. Preprint, not yet peer-reviewed.