Rich Nonverbal Sensing Technology for Automated Social Skills Training

Automated nonverbal sensing and feedback technologies, such as My Automated Conversation coacH (MACH), can provide a personalized means to better understand, evaluate, and improve human social interaction--for both practical and therapeutic purposes, and to advance future communications research. The first Web extra at http://youtu.be/l3ztu9shfMg discusses My Automated Conversation coacH (MACH), a system for people to practice social interactions in face-to-face scenarios. MACH consists of a 3D character that can see, hear, and make its own decisions in real time. The second Web extra at http://youtu.be/krdwB8bfXLQ discusses software developed at MIT that can be used to help people practice their interpersonal skills until they feel more comfortable with situations such as a job interview or a first date. The software, called MACH (short for My Automated Conversation coacH), uses a computer-generated onscreen face, along with facial, speech, and behavior analysis and synthesis software to simulate face-to-face conversations. It then provides users with feedback on their interactions.