Learning Therapist Policy from Therapist-Exoskeleton-Patient Interaction

TL;DR

A Patient-Therapist Force Field (PTFF) is proposed to visualize therapist responses to patient kinematics and a Synthetic Therapist (ST) machine learning model to support the therapist in dyadic robot-mediated physical interaction therapy.

Abstract

Post-stroke rehabilitation is often necessary for patients to regain proper walking gait. However, the typical therapy process can be exhausting and physically demanding for therapists, potentially reducing therapy intensity, duration, and consistency over time. We propose a Patient-Therapist Force Field (PTFF) to visualize therapist responses to patient kinematics and a Synthetic Therapist (ST) machine learning model to support the therapist in dyadic robot-mediated physical interaction therapy. The first encodes patient and therapist stride kinematics into a shared low-dimensional latent manifold using a Variational Autoencoder (VAE) and models their interaction through a Gaussian Mixture Model (GMM), which learns a probabilistic vector field mapping patient latent states to therapist responses. This representation visualizes patient-therapist interaction dynamics to inform therapy strategies and robot controller design. The latter is implemented as a Long Short-Term Memory (LSTM) network trained on patient-therapist interaction data to predict therapist-applied joint torques from patient kinematics. Trained and validated using leave-one-out cross-validation across eight post-stroke patients, the model was integrated into a ROS-based exoskeleton controller to generate real-time torque assistance based on predicted therapist responses. Offline results and preliminary testing indicate the potential of their use as an alternative approach to post-stroke exoskeleton therapy. The PTFF provides understanding of the therapist's actions while the ST frees the human therapist from the exoskeleton, allowing them to continuously monitor the patient's nuanced condition.

Figures (3)

• Figure 1: black Learning Therapist Policy from Therapist–Exoskeleton–Patient Interaction. (A) Previously collected dataset of therapist–exoskeleton–patient physical interaction through two lower-limb exoskeletons. The exoskeletons render virtual springs connecting the joint configurations of the patient and therapist. (B) Patient–Therapist Force Field, which takes as input the patient’s and therapist’s strides, extracts latent representations, and learns a force field connecting them in a lower-dimensional space. The model uses an encoder–decoder architecture (both displayed) to reduce dimensionality. (C) Synthetic Therapist, which takes as input the patient’s joint kinematics and predicts the corresponding therapist kinematics. The model uses a Long Short-Term Memory (LSTM) network (displayed) to infer the therapist’s trajectory.
• Figure 2: black Top: Latent space representation of each individual dyad. Each dot corresponds to a stride, while the ellipsoids display their distribution. Blue: patient left stride; green: therapist right stride; light blue: patient right stride; light green: therapist left stride. The connection is mirrored (patient left, therapist right). In the middle the resulting force field computed by fitting all the dyads using the GMM. Bottom: Force fields (from left to right): patient hip, therapist hip, patient knee, therapist knee.
• Figure 3: Example of Synthetic Therapist predictions (predicting 75ms into the future) overlayed with corresponding true therapist data and patient data. On top is presented the Hip Joint, while on the bottom the Knee joint.