Mental and Physical Health Management System Using ML, Computer Vision and IoT Sensor Network

Previously, healthcare management systems were particularly focused on physical health and disregarded the mental health. With technology that encompass all spheres of life, the benefits of technology in healthcare remain unfathomable. A person's emotion, body temperature and heart rate can provide insightful information on both mind and body. This paper demonstrates a complete healthcare management system that considers both physical as well as mental health. IoT sensor network and Arduino UNO is used to collect a person's body temperature and heart rate and simultaneously stored in a database. The paper also includes an emotion recognition unit that is built using the MiniXception convolutional neural network architecture to keep a track of the person's emotion. A natural language processing chatbot has been employed to enable a virtual doctor for the user and help the user to provide a preliminary diagnosis. Furthermore, the tools like HTMI5 and CSS have been employed to build the user interface. The data obtained is then stored using MySQL database service. The results of this implementation indicates that the proposed system can reduce the workload for doctors, to be more aware of their physical and mental health and lastly the proposed methodology will make healthcare to be more accessible.