Utilizing Voice Assistance and Wearable Interactive Mixed Reality Solutions for Industrial Training Workflows

Field workers under training often need assistance locating, recognizing, and familiarizing themselves with different machines and equipment. Whenever further guidance is needed, an expert is expected to assist using visual and auditory means. Thus, we employed an intelligent voice assistant system by integrating Augmented Reality (AR) and Natural Language Processing (NLP) methods to alleviate workflows and construct an interactive approach for field workers in training or practice. Microsoft HoloLens 2 was used as the Head Mounted Display (HMDs) to overlay necessary AR visuals and speech synthesis for user assistance. for its implementation, the multinomial Naive Bayes classification algorithm was performed at different sequential run-times throughout a standard operating procedure. This resulted in preserving training speeds and maintaining high accuracy when each and any unique attribute of a mechanical part is uttered. As the objective is to design an interactive training solution, further development in this research can be made by enhancing the user interface, interaction, and overall experience.