Evaluation of an embodied virtual communication system for human interaction analysis by synthesis

An embodied virtual face-to-face communication system with two types of avatars for human interaction analysis by synthesis is developed: one is a VirtualActor (VA) as a human avatar which represents interactive behavior such as the motions of head, arms and body, the other is a VirtualWave (VW) as an abstract avatar in which human behavior is simplified as the motion of wave to clarify an essential role of interaction. The system provides networked virtual communication environment in which two remote talkers can share embodied interaction through their VA or VW including themselves in the same virtual space. The effectiveness of the system is demonstrated by the sensory evaluation and behavioral analysis of the communication experiment in 13 pairs of 26 talkers under various conditions such as the time lag of motion and voice. The importance of mutual embodied sharing in communication is also clarified The system would be expected to form the foundation of information media and communication technologies as well as the methodology for the analysis and understanding of various human interactions.