A VoIP-based voice interaction system for a virtual telephone operator using video calls

We have developed a telephone operator system using a spoken dialogue system. The system can be used for video calls, with Microsoft Lync used as the VoIP client. The spoken dialogue system is used in the system to display a 3D character, and to interact with the user over the video call. In this study, the interactive scenario for the telephone operator is automatically generated from a university employee database. Experimental results from subjects using the system showed good system performance.