A Task Manual Creation Support System Using Automatic Speech Recognition

This paper proposes an application to support the creation of specific task manual by automatic speech recognition (ASR). In our daily life or work, while we performing some specific tasks like cooking in-house, assemble a computer or making a handcrafted product in a factory, people who are not expert in the specific task, they often need to reference a task manual. To create a specific task manual, the specific task expert has to list up all the procedures or take photos, edits or structure the contents by rearranging the images or texts to create the task manual. However, in such method, it is often that the important information such as tips, trick or specific procedures could lack information or be missing. To minimize this problem, we developed a prototype of a task manual creation support system. The specific task expert can capture the video of the specific task including the explanation speech uttered by the expert with a human eye perspective camera and a directional microphone. The subjective experimental result showed that the usage of ASR helped to create and edit the task descriptions and to improve the efficiency of task manual creation.