SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking
Tianhong Catherine Yu, Manru Mary Zhang, Peter He, Chi-Jung Lee, Cassidy Cheesman, Saif Mahmud, Ruidong Zhang, François Guimbretière, Cheng Zhang
TL;DR
SeamPose introduces a minimally obtrusive approach to upper-body pose tracking by repurposing existing shirt seams as capacitive sensors. A proof-of-concept long-sleeve shirt with eight conductive seams feeds a tailored deep-learning pipeline that estimates 3D joint positions relative to the pelvis, achieving an MPJPE of 6.0 cm in a 12-person study. The method preserves the garment’s aesthetics and comfort while delivering competitive tracking performance against prior wearable systems. Key contributions include a fabrication workflow for conductive seams, a compact 8-channel sensing board, and a two-stage training regime (user-independent plus user-adaptive) to handle inter-user variability. The work lays groundwork for scalable, everyday wearable pose tracking, with future work addressing broader garment patterns, real-world deployment, and washable, manufacturable designs.
Abstract
Seams are areas of overlapping fabric formed by stitching two or more pieces of fabric together in the cut-and-sew apparel manufacturing process. In SeamPose, we repurposed seams as capacitive sensors in a shirt for continuous upper-body pose estimation. Compared to previous all-textile motion-capturing garments that place the electrodes on the clothing surface, our solution leverages existing seams inside of a shirt by machine-sewing insulated conductive threads over the seams. The unique invisibilities and placements of the seams afford the sensing shirt to look and wear similarly as a conventional shirt while providing exciting pose-tracking capabilities. To validate this approach, we implemented a proof-of-concept untethered shirt with 8 capacitive sensing seams. With a 12-participant user study, our customized deep-learning pipeline accurately estimates the relative (to the pelvis) upper-body 3D joint positions with a mean per joint position error (MPJPE) of 6.0 cm. SeamPose represents a step towards unobtrusive integration of smart clothing for everyday pose estimation.
