FedAccess: Federated Learning-Based Built Surface Recognition for Wheelchair Routing

Wheelchair and mobility aid users often face challenges in navigating the built environment due to uneven sidewalks, temporary barriers, steep inclines, and narrow lanes. To assist these users, accessible routing systems have been introduced that generate wheelchair-accessible paths to facilitate navigation in unfamiliar environments. In general, accessible routing systems rely on surface and path characteristics like surface type, incline, width, etc., and crowd-sourced information about barriers to provide the optimal route. Emerging routing systems even provide personalized routing to users that are catered to the user's specific needs and requirements. However, these types of systems collect crowd-sourced personal/identifiable information which introduces privacy and data heterogeneity concerns that are not addressed by them or elsewhere in the concerned domain. To address these two issues specifically, we propose the novel FedAccess system for accessible routing that utilizes the federated learning paradigm for surface recognition using vibration data. The surface-induced vibrations are captured through smartphone-embedded motion sensors (accelerometers and gyroscopes) from 23 manual wheelchair users during their regular navigation. We have covered 10 distinct surfaces from the USA. As a result, the distribution of the data is naturally non-IID. Empirical evaluation shows that the FedAccess system can protect user data and identity while dealing with non-IID data and still recognize heterogeneous surfaces with higher accuracy than the state-of-the-art.