Whole-body pose estimation in physical rider-bicycle interactions with a monocular camera and a set of wearable gyroscopes

We report the development of a human whole-body pose estimation scheme with application to rider-bicycle interactions. The estimation scheme is built on the fusion of measurements of a monocular camera on the bicycle and a set of small wearable gyroscopes attached to the rider's upper- and lower-limb and the trunk. A single feature point is collocated with each wearable gyroscope and also on the segment link where the gyroscope is not attached. An extended Kalman filter is designed to fuse the vision-inertial measurements to obtain accurate whole-body poses. The estimation design also incorporates a set of constraints from human anatomy and the physical rider-bicycle interactions. We demonstrate and compare the performance of the estimation design through multiple subjects riding experiments.