PalpAid: Multimodal Pneumatic Tactile Sensor for Tissue Palpation
Devi Yuliarti, Ravi Prakash, Hiu Ching Cheung, Amy Strong, Patrick J. Codd, Shan Lin
TL;DR
This work addresses the sensory gap in robot-assisted surgery by introducing PalpAid, a modular multimodal pneumatic tactile sensor that converts contact force into internal pressure changes while capturing acoustic signals via an onboard microphone. The device integrates a compliant silicone palpator, a pressure sensor, and a MEMS microphone mounted on a UR3e manipulator, enabling tissue classification through simultaneous pressure events and acoustic signatures. Experiments demonstrate the ability to distinguish hard 3D-printed PLA infills from ex vivo soft tissues using MFCC features with an SVM classifier, achieving varying levels of accuracy across materials (e.g., 100% for certain soft tissues, 75–100% for PLA infills). PalpAid offers a low-cost, compact solution for real-time tissue delineation with potential for easy sterilization and robotic-handheld deployment, while highlighting avenues for refinement in closed-loop control and higher spatial resolution.
Abstract
The tactile properties of tissue, such as elasticity and stiffness, often play an important role in surgical oncology when identifying tumors and pathological tissue boundaries. Though extremely valuable, robot-assisted surgery comes at the cost of reduced sensory information to the surgeon; typically, only vision is available. Sensors proposed to overcome this sensory desert are often bulky, complex, and incompatible with the surgical workflow. We present PalpAid, a multimodal pneumatic tactile sensor equipped with a microphone and pressure sensor, converting contact force into an internal pressure differential. The pressure sensor acts as an event detector, while the auditory signature captured by the microphone assists in tissue delineation. We show the design, fabrication, and assembly of sensory units with characterization tests to show robustness to use, inflation-deflation cycles, and integration with a robotic system. Finally, we show the sensor's ability to classify 3D-printed hard objects with varying infills and soft ex vivo tissues. Overall, PalpAid aims to fill the sensory gap intelligently and allow improved clinical decision-making.
