gesture recognition

pose

gestures

compounds_56947

anammox process

community pharmacy

radiochemical

parkinson_108235

grasp

glove

motion capture

mncs

recognition_60604

proglucagon

robotic_39397

shared mobility

force estimation

object_129016

event-triggering

ibid_76964

ACM Transactions on Graphics

We propose a stretch-sensing soft glove to interactively capture hand poses with high accuracy and without requiring an external optical setup. We demonstrate how our device can be fabricated and calibrated at low cost, using simple tools available in most fabrication labs. To reconstruct the pose from the capacitive sensors embedded in the glove, we propose a deep network architecture that exploits the spatial layout of the sensor itself. The network is trained only once, using an inexpensive off-the-shelf hand pose reconstruction system to gather the training data. The per-user calibration is then performed on-the-fly using only the glove. The glove's capabilities are demonstrated in a series of ablative experiments, exploring different models and calibration methods. Comparing against commercial data gloves, we achieve a 35% improvement in reconstruction accuracy.

Interactive hand pose estimation using a stretch-sensing soft glove