Development of GUI application for multimodal analysis for evaluation of swallowing function

This paper details a graphical user interface (GUI) application that uses three different types of signals - myoelectric, swallowing sound, and ultrasound video images - to compare and analyze data from synchronous and simultaneous inputs. These signals are important to capture different aspects of the swallowing process, with each providing different information. Myoelectricity records the activity of the muscles involved in swallowing, and swallowing sounds capture the sound of food as it passes down the throat. Furthermore, ultrasound moving images provide a visual representation of the movement of the throat structures. Recording these signals simultaneously in a coaxial fashion and analyzing them in an integrated manner facilitates the detailed evaluation of the swallowing function. A newly developed GUI application was used to synchronize and analyze the signals, enabling more accurate evaluation of each stage of the swallowing function. The application is designed to be intuitive and simplifies the process from data collection to analysis and evaluation. The application revealed aspects of swallowing function not discernible from individual signals alone, demonstrating the usefulness of the developed application.