Advancing Remote Medical Palpation through Cognition and Emotion

TL;DR

The paper tackles the challenge of remote palpation by arguing that effective telemedicine must reproduce the cognitive and emotional dimensions of palpation, not just tactile signals. It proposes a remote palpation framework built on two interacting pathways—active touch by the doctor and passive touch by the patient—coupled with multimodal feedback and computer mediated reality to support diagnostic reasoning. Key contributions include a detailed somatosensory-informed cognitive model, a plan for hardware-software integration via robotic actuation, tactile sensing, and AR/VR interfaces, and guidance on doctor and patient environments to preserve clinical reasoning and emotional engagement. The work aims to enhance remote diagnosis, maintain the doctor-patient rapport, and provide a foundation for further development of cognitively and emotionally aware telepalpation systems.

Abstract

This paper explores the cognitive and emotional processes involved in medical palpation to develop a more effective remote palpation system. Conventional remote palpation systems primarily rely on force feedback to convey a patient's tactile condition to doctors. However, an analysis of the palpation process suggests that its primary goal is not merely to assess the detailed tactile properties of the affected area but to integrate tactile sensations with other assessments, past experiences, memories, and patient reactions -- both physical and emotional -- to form a comprehensive understanding of the medical condition. To support this perspective, we describe two critical signal pathways involved in the perception of tactile sensations for both doctors and patients. For doctors, perception arises from active touch, requiring the simultaneous stimulation of kinesthetic and tactile sensations. In contrast, patients experience tactile sensations through passive touch, which often elicits more subjective and emotional responses. Patients perceive this stimulation both explicitly and implicitly, and doctors interpret these reactions as part of the diagnostic process. Based on these findings, we propose a remote palpation system that leverages multimodal interaction to enhance remote diagnosis. The system prioritizes cognitive and emotional processes to realize effective palpation, overcoming technical challenges in replicating the full sensory experience.

Figures (2)

• Figure 1: Signal pathways for perception during palpation: Active touch represents the doctor's perception pathway, where direct interaction with the patient triggers cognitive processes that integrate tactile sensations, past experiences, and other assessments to form a clear understanding of the medical condition. Passive touch represents the patient's perception pathway, where the doctor’s touch elicits both explicit and implicit responses. Explicit perceptions are verbally communicated, while implicit responses—such as changes in facial expression, tone of voice, and body movements—convey the patient’s emotional state.
• Figure 2: Telecommunication-vased palpation setup: mixed-reality interaction for remote diagnosis. a) Doctor's Environment – The doctor wears a VR headset that renders a view of the patient, allowing them to interact with the patient replica using tactile displays on their fingers to perceive haptic feedback. b) Patient Replica – A detailed view of the patient replica, where the doctor’s active touch is applied. The replica transmits the mechanical touch to the actuator in the patient's environment, which delivers the touch to the patient and transmits the corresponding haptic feedback to the doctor. c) Patient's Environment – Two vertically arranged displays provide the patient with visual feedback: one showing the doctor’s face and the other displaying the patient’s hand augmented with the doctor’s hands. d) Rotating and translating gantry with linearp robing actuator – The actuator receives the doctor’s touch from the replica, delivering it to the patient, while also transmitting haptic sensations back to the doctor’s side.