Abstract:
With the wide application of service robots in people's daily life, people are not only satisfied with robots accomplishing tasks independently but also hope that robots ...Show MoreMetadata
Abstract:
With the wide application of service robots in people's daily life, people are not only satisfied with robots accomplishing tasks independently but also hope that robots can maintain sustainable interaction with human beings. Especially in the field of music, robots need to be equipped with intelligent cognitive skills in decision-making, so that the audience can enjoy immersive appreciation and emotional resonance in the robots performance. Visual perception and natural language understanding are essential for robots to establish human-robot friendly relationships. To enrich the interactive ability of music robots, we design a contactless interaction system based on facial expression recognition, which consists of four modules: voice wake-up, face detection, facial expression recognition, and music mapping. When people wake up the music robot with specific words, the robot will customize appropriate music to perform according to the recognition results of the FER module. As a final step, the interaction system has been successfully applied to the piano humanoid robot independently developed by our team.
Date of Conference: 05-09 December 2022
Date Added to IEEE Xplore: 18 January 2023
ISBN Information:
Funding Agency:
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Facial Expressions ,
- Interactive System ,
- Face Recognition ,
- Humanoid Robot ,
- Facial Expression Recognition ,
- Interactive ,
- Natural Language ,
- Visual Perception ,
- People’s Daily ,
- Face Detection ,
- Decision-making Skills ,
- Results Of Module ,
- Service Robots ,
- Natural Language Understanding ,
- Convolutional Neural Network ,
- Deep Neural Network ,
- Human Life ,
- Local Features ,
- Microphone ,
- Attention Mechanism ,
- Intelligent Robots ,
- Human-robot Interaction ,
- Pop Music ,
- Bounding Box ,
- Class Center ,
- Loss Of Affinity ,
- Deep Features ,
- Attention Network ,
- Nursery Rhymes
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Facial Expressions ,
- Interactive System ,
- Face Recognition ,
- Humanoid Robot ,
- Facial Expression Recognition ,
- Interactive ,
- Natural Language ,
- Visual Perception ,
- People’s Daily ,
- Face Detection ,
- Decision-making Skills ,
- Results Of Module ,
- Service Robots ,
- Natural Language Understanding ,
- Convolutional Neural Network ,
- Deep Neural Network ,
- Human Life ,
- Local Features ,
- Microphone ,
- Attention Mechanism ,
- Intelligent Robots ,
- Human-robot Interaction ,
- Pop Music ,
- Bounding Box ,
- Class Center ,
- Loss Of Affinity ,
- Deep Features ,
- Attention Network ,
- Nursery Rhymes