MM-Loc: Cross-sensor Indoor Smartphone Location Tracking using Multimodal Deep Neural Networks

Indoor positioning systems have been explored for decades to facilitate universal location-based services. However, complex environment conditions and sensing imperfections continue to be limiting factors to their large scale adoption. Rather than customising more ingenious solutions to handle corner cases in complex environments, we believe that a more efficient solution is to learn entirely from data with minimal engineering effort. We develop neural network based solutions for two positioning approaches, modelling Dead Reckoning with recurrent neural networks and WiFi Fingerprinting with deep neural networks. We propose a multimodal deep neural network architecture (MM-Loc) that bridges the features extracted by the modality-specific complements (sensor based and WiFi based) to join the two perspectives. We observe that this multimodal approach is better than single-modality models, and elegantly trains directly from raw data with minimal intervention.