Autonomous Soil Collection in Environments With Heterogeneous Terrain
Andrew Dudash, Beyonce Andrades, Ryan Rubel, Mohammad Goli, Nathan Clark, William Ewald
TL;DR
This work tackles autonomous soil collection in heterogeneous amorphous terrain by deploying a general-purpose 7-DOF robotic arm equipped with a wrist camera and a two-finger gripper. A vision-guided pipeline uses semantic segmentation via a U-Net, followed by contour-based localization and 3D pose estimation to select soil regions, while MoveIt with an RRT* planner and a proportional depth controller execute pickup. The authors validate the prototype through arm-performance and vision-ablation experiments, reporting robust soil collection in both homogeneous and heterogeneous terrains and showing that data augmentation in training substantially improves segmentation. The results demonstrate the feasibility of autonomous soil sampling without niche hardware, highlighting practical implications for robotic agriculture, surveying, and hazard detection, and outlining directions for outdoor testing and control-system enhancements.
Abstract
To autonomously collect soil in uncultivated terrain, robotic arms must distinguish between different amorphous materials and submerge themselves into the correct material. We develop a prototype that collects soil in heterogeneous terrain. If mounted to a mobile robot, it can be used to perform soil collection and analysis without human intervention. Unique among soil sampling robots, we use a general-purpose robotic arm rather than a soil core sampler.
