Abstract:
The ability to recognize emotion is one of the hallmarks of emotional intelligence, an aspect of human intelligence that has been argued to be even more important than ma...Show MoreMetadata
Abstract:
The ability to recognize emotion is one of the hallmarks of emotional intelligence, an aspect of human intelligence that has been argued to be even more important than mathematical and verbal intelligences. This paper proposes that machine intelligence needs to include emotional intelligence and demonstrates results toward this goal: developing a machine's ability to recognize the human affective state given four physiological signals. We describe difficult issues unique to obtaining reliable affective data and collect a large set of data from a subject trying to elicit and experience each of eight emotional states, daily, over multiple weeks. This paper presents and compares multiple algorithms for feature-based recognition of emotional state from this data. We analyze four physiological signals that exhibit problematic day-to-day variations: The features of different emotions on the same day tend to cluster more tightly than do the features of the same emotion on different days. To handle the daily variations, we propose new features and algorithms and compare their performance. We find that the technique of seeding a Fisher Projection with the results of sequential floating forward search improves the performance of the Fisher Projection and provides the highest recognition rates reported to date for classification of affect from physiology: 81 percent recognition accuracy on eight classes of emotion, including neutral.
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence ( Volume: 23, Issue: 10, October 2001)
DOI: 10.1109/34.954607
MIT Media Laboratory, Cambridge, MA, USA
Rosalind W. Picard earned the bachelors degree in electrical engineering with highest honors from the Georgia Institute of Technology in 1984. She was named a National Science Foundation Graduate Fellow and worked as a member of the technical staff at AT&T Bell Laboratories from 1984-1987, designing VLSI chips for digital signal processing and developing new methods of adaptive image compression. She earned the masters an...Show More
Rosalind W. Picard earned the bachelors degree in electrical engineering with highest honors from the Georgia Institute of Technology in 1984. She was named a National Science Foundation Graduate Fellow and worked as a member of the technical staff at AT&T Bell Laboratories from 1984-1987, designing VLSI chips for digital signal processing and developing new methods of adaptive image compression. She earned the masters an...View more
Athens, Greece
Elias Vyzas received the BEngr degree in mechanical engineering from Imperial College, London, England in June 1994, and two MS degrees, one in mechanical engineering and one in electrical engineering and computer science, from MIT in January 1997. He received the masters degree in mechanical engineering from MIT in June 1999 and is currently completing service in the Greek Army. His research interests include affect and ...Show More
Elias Vyzas received the BEngr degree in mechanical engineering from Imperial College, London, England in June 1994, and two MS degrees, one in mechanical engineering and one in electrical engineering and computer science, from MIT in January 1997. He received the masters degree in mechanical engineering from MIT in June 1999 and is currently completing service in the Greek Army. His research interests include affect and ...View more
IBM Thomas J. Watson Research Center, Yorktown Heights, NY, USA
Jennifer Healey received the BS (1993), the MS (1995) and the PhD (2000) degrees from MIT in electrical engineering and computer science. Her Master's thesis work in the field of optics and opto-electronics was completed at the Charles Stark Draper Laboratory. In 1995, she joined the MIT Media Laboratory and helped launch the Affective Computing research project. She held a postdoctoral position at IBM's Zurich Research L...Show More
Jennifer Healey received the BS (1993), the MS (1995) and the PhD (2000) degrees from MIT in electrical engineering and computer science. Her Master's thesis work in the field of optics and opto-electronics was completed at the Charles Stark Draper Laboratory. In 1995, she joined the MIT Media Laboratory and helped launch the Affective Computing research project. She held a postdoctoral position at IBM's Zurich Research L...View more
Contents MIT Media Laboratory, Cambridge, MA, USA
Rosalind W. Picard earned the bachelors degree in electrical engineering with highest honors from the Georgia Institute of Technology in 1984. She was named a National Science Foundation Graduate Fellow and worked as a member of the technical staff at AT&T Bell Laboratories from 1984-1987, designing VLSI chips for digital signal processing and developing new methods of adaptive image compression. She earned the masters and doctorate degrees, both in electrical engineering and computer science, from the Massachusetts Institute of Technology (MIT) in 1986 and 1991, respectively. In 1991, she joined the MIT Media Laboratory as an assistant professor. She was promoted to associate professor in 1995 and awarded tenure at MIT in 1998. She is author or co-author of more than 80 peer reviewed scientific articles in pattern recognition, multidimensional signal modeling, computer vision, and human-computer interaction. She is a co-recipient with Tom Minka of a best paper prize (1998) from the Pattern Recognition Society for work on machine learning with multiple models. Dr. Picard guest edited the IEEE Transactions on Pattern Analysis and Machine Intelligence special issue on Digital Libraries: Representation and Retrieval, and edited the proceedings of the First IEEE International Workshop on Content-Based Access of Image and Video Libraries, for which she served as chair. Her award-winning book, Affective Computing, (MIT Press, 1997) lays the groundwork for giving machines skills of emotional intelligence. She is a senior member of the IEEE and a member of the IEEE Computer Society.
Rosalind W. Picard earned the bachelors degree in electrical engineering with highest honors from the Georgia Institute of Technology in 1984. She was named a National Science Foundation Graduate Fellow and worked as a member of the technical staff at AT&T Bell Laboratories from 1984-1987, designing VLSI chips for digital signal processing and developing new methods of adaptive image compression. She earned the masters and doctorate degrees, both in electrical engineering and computer science, from the Massachusetts Institute of Technology (MIT) in 1986 and 1991, respectively. In 1991, she joined the MIT Media Laboratory as an assistant professor. She was promoted to associate professor in 1995 and awarded tenure at MIT in 1998. She is author or co-author of more than 80 peer reviewed scientific articles in pattern recognition, multidimensional signal modeling, computer vision, and human-computer interaction. She is a co-recipient with Tom Minka of a best paper prize (1998) from the Pattern Recognition Society for work on machine learning with multiple models. Dr. Picard guest edited the IEEE Transactions on Pattern Analysis and Machine Intelligence special issue on Digital Libraries: Representation and Retrieval, and edited the proceedings of the First IEEE International Workshop on Content-Based Access of Image and Video Libraries, for which she served as chair. Her award-winning book, Affective Computing, (MIT Press, 1997) lays the groundwork for giving machines skills of emotional intelligence. She is a senior member of the IEEE and a member of the IEEE Computer Society.View more
Athens, Greece
Elias Vyzas received the BEngr degree in mechanical engineering from Imperial College, London, England in June 1994, and two MS degrees, one in mechanical engineering and one in electrical engineering and computer science, from MIT in January 1997. He received the masters degree in mechanical engineering from MIT in June 1999 and is currently completing service in the Greek Army. His research interests include affect and stress recognition from physiology, and assessment of mental workload and performance.
Elias Vyzas received the BEngr degree in mechanical engineering from Imperial College, London, England in June 1994, and two MS degrees, one in mechanical engineering and one in electrical engineering and computer science, from MIT in January 1997. He received the masters degree in mechanical engineering from MIT in June 1999 and is currently completing service in the Greek Army. His research interests include affect and stress recognition from physiology, and assessment of mental workload and performance.View more
IBM Thomas J. Watson Research Center, Yorktown Heights, NY, USA
Jennifer Healey received the BS (1993), the MS (1995) and the PhD (2000) degrees from MIT in electrical engineering and computer science. Her Master's thesis work in the field of optics and opto-electronics was completed at the Charles Stark Draper Laboratory. In 1995, she joined the MIT Media Laboratory and helped launch the Affective Computing research project. She held a postdoctoral position at IBM's Zurich Research Laboratory in artifical intelligence and knowledge management. She is currently a research staff member in the Human Language Technologies Group at IBM's T.J. Watson Research Center.
Jennifer Healey received the BS (1993), the MS (1995) and the PhD (2000) degrees from MIT in electrical engineering and computer science. Her Master's thesis work in the field of optics and opto-electronics was completed at the Charles Stark Draper Laboratory. In 1995, she joined the MIT Media Laboratory and helped launch the Affective Computing research project. She held a postdoctoral position at IBM's Zurich Research Laboratory in artifical intelligence and knowledge management. She is currently a research staff member in the Human Language Technologies Group at IBM's T.J. Watson Research Center.View more
