A Mobile-Based Multimodal Framework for Pervasive Health Monitoring

Pervasive health monitoring tools and applications based on mobile devices can be used for digital phenotyping, thereby facilitating diagnosis and treatment of diseases. We present the development of an unobtrusive health monitoring framework, enabling multimodal data collection of activity information from wearable devices, smartphones, and third-party apps, keystroke typing data, location information, data from medical and environmental IoT devices, and self-reports. The architectural elements of the framework are presented, and proof-of-concept case studies based on the developed framework are demonstrated, to show its feasibility and value in building different pervasive health applications.