Vision Controlled Matter Smart Home Solution for Dysdiadochokinesia Patients

Smart home products are means of comfort for many, but they are still of dire need for a few. Dysdiadochokinesia (DDK) is a type of disease which results in difficulty in performing fast, consecutive action, most probably because of a prevailed issue. Matter is constructed with an aim of making smart home products interoperable, easy to use and smooth without compromising on security. By stacking the same on top of Internet Protocol (IP) layer, Matter will make communication possible across smart home products, mobile-based applications, and cloud-based services, and demonstrate a specific set of IP networking technologies for the certification of smart products. Development of an independent smart home solution for people suffering from Dysdiadochokinesia is proposed in this work. The system proposed enables them to travel indoors using a vision-controlled wheelchair and establish control over home appliances via vision commands by leveraging Matter Smart Home Protocol. Eye gaze movements and eye blinks are used as controlling parameters which are fed to machine learning models such as SVM and KNN which produces a classification label. Controller designed is tested for the movements of wheelchair in either of the four directions and also for controlling Matter enabled light and door lock producing promising results.

I. Introduction

Dysdiadochokinesia (DDK) is a type of disease which results in difficulty in performing fast, consecutive action, most probably because of a prevailed issue. Normal people can quickly change between opposing motions in a synchronized way, like when removing a bulb from its socket. But someone with DDK would experience that their muscle reaction has reduced pace or is restricted, specifically in the lower and upper limbs. This can comprise of improper synchronization while quickly tapping finger or foot, closing, and opening the fist, and changing muscular postures. DDK is majorly a result of uneven functioning of the cerebellum. Dysdiadochokinesia and Multiple Sclerosis (MS) is spread across people from various geographic locations, belonging to varied age groups. MS is estimated to affect over 2.8 million people worldwide and is typically diagnosed between the ages of 20 and 40, but can occur at any age. Women are two to three times more likely to be diagnosed with this than men. About 50% of people with MS will require a wheelchair at some point in their lives, and up to 90% will experience some degree of disability [1].