Multioccupancy Activity Recognition Based on Deep Learning Models Fusing UWB Localization Heatmaps and Nearby-Sensor Interaction

Human activity recognition (HAR) focuses on developing systems and techniques to recognize and categorize human actions automatically based on sensor data. This study combines ultrawideband (UWB) technology and binary sensors to describe and recognize daily activities in real-world environments with multiple occupants, ensuring accurate user localization through noninvasive and privacy-respecting methods. A novel method that combines wearables with UWB technology, which allows the generation of heatmaps for accurate positioning, and binary sensors, which collect nearby interaction with daily activities in naturalistic conditions, is presented. A dataset composed of real-world data collected from three individuals in a real-life environment (house) was compiled. Advanced deep learning models are implemented to effectively fuse spatiotemporal information, leading to an encouraging performance in recognition of daily activities. The promising results suggest that this approach could be viable for large-scale deployments in future smart environments.