Abstract:
Despite a long history of research, the development of synthetic tactual aids to support the communication of speech has proven to be a difficult task. The current paper ...Show MoreMetadata
Abstract:
Despite a long history of research, the development of synthetic tactual aids to support the communication of speech has proven to be a difficult task. The current paper describes a new tactile speech device based on the presentation of phonemic-based tactile codes. The device consists of 24 tactors under independent control for stimulation at the forearm. Using properties that include frequency and waveform of stimulation, amplitude, spatial location, and movement characteristics, unique tactile codes were designed for 39 consonant and vowel phonemes of the English language. The strategy for mapping the phonemes to tactile symbols is described, and properties of the individual phonemic codes are provided. Results are reported for an exploratory study of the ability of 10 young adults to identify the tactile symbols. The participants were trained to identify sets of consonants and vowels, before being tested on the full set of 39 tactile codes. The results indicate a mean recognition rate of 86 percent correct within one to four hours of training across participants. Thus, these results support the viability of a phonemic-based approach for conveying speech information through the tactile sense.
Published in: IEEE Transactions on Haptics ( Volume: 12, Issue: 1, 01 Jan.-March 2019)
Funding Agency:
Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
Charlotte M. Reed received the B.S. degree in education from Carlow College, Carlow, Ireland, in 1969 and the Ph.D. degree in bioacoustics from the University of Pittsburgh, Pittsburgh, PA, USA, in 1973. She is currently a Senior Research Scientist with the Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA.
Charlotte M. Reed received the B.S. degree in education from Carlow College, Carlow, Ireland, in 1969 and the Ph.D. degree in bioacoustics from the University of Pittsburgh, Pittsburgh, PA, USA, in 1973. She is currently a Senior Research Scientist with the Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Hong Z. Tan received the bachelor's degree in biomedical engineering from Shanghai Jiao Tong University, Shanghai, China, in 1986, and the master's degree in electrical engineering and the doctorate degree in computer science from the Massachusetts Institute of Technology, Cambridge, MA, USA, in 1988 and 1996, respectively. She is currently a Professor of electrical and computer engineering, mechanical engineerg (by court...Show More
Hong Z. Tan received the bachelor's degree in biomedical engineering from Shanghai Jiao Tong University, Shanghai, China, in 1986, and the master's degree in electrical engineering and the doctorate degree in computer science from the Massachusetts Institute of Technology, Cambridge, MA, USA, in 1988 and 1996, respectively. She is currently a Professor of electrical and computer engineering, mechanical engineerg (by court...View more
Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
Zach Perez received the bachelor's degree in chemistry from the Massachusetts Institute of Technology, Cambridge, MA, USA, in 2005 and the Juris Doctor degree from the Georgetown University Law Center, Washington, DC, USA, in 2012. He is currently a Senior Research Support Associate with the Research Laboratory of Electronics, Massachusetts Institute of Technology.
Zach Perez received the bachelor's degree in chemistry from the Massachusetts Institute of Technology, Cambridge, MA, USA, in 2005 and the Juris Doctor degree from the Georgetown University Law Center, Washington, DC, USA, in 2012. He is currently a Senior Research Support Associate with the Research Laboratory of Electronics, Massachusetts Institute of Technology.View more
Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
E. Courtenay Wilson received the B.S. degree in computer science and engineering from the University of Connecticut, Storrs, CT, USA, in 1994, the M.S. degree in computer engineering from the University of Nevada, Reno, NV, USA, in 2001, and the Ph.D. degree in speech and hearing bioscience and technology from the Massachusetts Institute of Technology (MIT), Cambridge, MA, USA, in 2010. She is currently a Researcher with ...Show More
E. Courtenay Wilson received the B.S. degree in computer science and engineering from the University of Connecticut, Storrs, CT, USA, in 1994, the M.S. degree in computer engineering from the University of Nevada, Reno, NV, USA, in 2001, and the Ph.D. degree in speech and hearing bioscience and technology from the Massachusetts Institute of Technology (MIT), Cambridge, MA, USA, in 2010. She is currently a Researcher with ...View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Frederico M. Severgnini received the B.A.Sc. degree in electronic and telecommunication engineering from PUC Minas University, Belo Horizonte, Brazil, in 2015 and the M.S. degree in electrical and computer engineering from Purdue University, West Lafayette, IN, USA, in 2018. He was a Graduate Research Assistant with the Haptic Interface Research Lab advised by Dr. H. Z. Tan.
Frederico M. Severgnini received the B.A.Sc. degree in electronic and telecommunication engineering from PUC Minas University, Belo Horizonte, Brazil, in 2015 and the M.S. degree in electrical and computer engineering from Purdue University, West Lafayette, IN, USA, in 2018. He was a Graduate Research Assistant with the Haptic Interface Research Lab advised by Dr. H. Z. Tan.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Jaehong Jung is working toward the B.S. degree in the School of Mechanical Engineering, Purdue University, West Lafayette, IN, USA. He is an Undergraduate Research Assistant with the Haptic Interface Research Lab, Purdue University, under the supervision of Dr. H. Z. Tan.
Jaehong Jung is working toward the B.S. degree in the School of Mechanical Engineering, Purdue University, West Lafayette, IN, USA. He is an Undergraduate Research Assistant with the Haptic Interface Research Lab, Purdue University, under the supervision of Dr. H. Z. Tan.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Juan S. Martinez received the B.A.Sc. degrees in electronic engineering and systems and computer engineering from Los Andes University, Bogota, Colombia, in 2016 and 2017, respectively. He is currently working toward the M.S. degree at Purdue University, West Lafayette, IN, USA, where he is a Research Assistant in the Haptic Interface Research Lab, advised by Dr. H. Z. Tan.
Juan S. Martinez received the B.A.Sc. degrees in electronic engineering and systems and computer engineering from Los Andes University, Bogota, Colombia, in 2016 and 2017, respectively. He is currently working toward the M.S. degree at Purdue University, West Lafayette, IN, USA, where he is a Research Assistant in the Haptic Interface Research Lab, advised by Dr. H. Z. Tan.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Yang Jiao received the B.E. degree in electronic information science and technology from the Beijing University of Posts and Telecommunications, Beijing, China, in 2009, the M.S. degree in wireless communications from the University of Southampton, Southampton, U.K., in 2010, and the Ph.D. degree in design from Tsinghua University, Beijing, China, in 2017. He is currently a Postdoctoral Research Associate at Purdue Univer...Show More
Yang Jiao received the B.E. degree in electronic information science and technology from the Beijing University of Posts and Telecommunications, Beijing, China, in 2009, the M.S. degree in wireless communications from the University of Southampton, Southampton, U.K., in 2010, and the Ph.D. degree in design from Tsinghua University, Beijing, China, in 2017. He is currently a Postdoctoral Research Associate at Purdue Univer...View more
Facebook Inc., Menlo Park, CA, USA
Ali Israr received the B.S. degree in mechanical engineering from the University of Engineering & Technology, Lahore, Pakistan, and the M.S. and Ph.D. degrees in mechanical engineering from Purdue University, West Lafayette, IN, USA.
Ali Israr received the B.S. degree in mechanical engineering from the University of Engineering & Technology, Lahore, Pakistan, and the M.S. and Ph.D. degrees in mechanical engineering from Purdue University, West Lafayette, IN, USA.View more
Facebook Inc., Menlo Park, CA, USA
Frances Lau received the B.A.Sc. degree in electrical engineering from the University of Toronto, Toronto, ON, Canada, in 2005, and the M.S. and Ph.D. degrees in electrical engineering from Stanford University, Stanford, CA, USA, in 2007 and 2013, respectively. She is currently working on research and development of haptic communication systems at Facebook, Menlo Park, CA, USA.
Frances Lau received the B.A.Sc. degree in electrical engineering from the University of Toronto, Toronto, ON, Canada, in 2005, and the M.S. and Ph.D. degrees in electrical engineering from Stanford University, Stanford, CA, USA, in 2007 and 2013, respectively. She is currently working on research and development of haptic communication systems at Facebook, Menlo Park, CA, USA.View more
Facebook Inc., Menlo Park, CA, USA
Keith Klumb received the bachelor's degree in electrical engineering technology from Purdue Unviersity, West Lafayette, IN, USA, in 2001. He is currently a Research Program Manager with Facebook, Menlo Park, CA, USA.
Keith Klumb received the bachelor's degree in electrical engineering technology from Purdue Unviersity, West Lafayette, IN, USA, in 2001. He is currently a Research Program Manager with Facebook, Menlo Park, CA, USA.View more
Facebook Inc., Menlo Park, CA, USA
Robert Turcott received the Ph.D. degree in electrical engineering with a focus on signal processing from Columbia University, New York, NY, USA, and the M.D. degree from Stanford University, Stanford, CA, USA. When he is not practicing cardiology, he serves as a consultant in the medical device and technology industries.
Robert Turcott received the Ph.D. degree in electrical engineering with a focus on signal processing from Columbia University, New York, NY, USA, and the M.D. degree from Stanford University, Stanford, CA, USA. When he is not practicing cardiology, he serves as a consultant in the medical device and technology industries.View more
Facebook Inc., Menlo Park, CA, USA
Freddy Abnousi received the M.D. degree from the Stanford University School of Medicine, Stanford, CA, USA, the M.B.A. degree from Oxford University, Oxford, U.K., and the M.Sc. degree in health policy, planning, and financing from the London School of Economics, London, U.K. He is an interventional cardiologist specializing in coronary and structural interventions. He currently leads haptic communication efforts at Faceb...Show More
Freddy Abnousi received the M.D. degree from the Stanford University School of Medicine, Stanford, CA, USA, the M.B.A. degree from Oxford University, Oxford, U.K., and the M.Sc. degree in health policy, planning, and financing from the London School of Economics, London, U.K. He is an interventional cardiologist specializing in coronary and structural interventions. He currently leads haptic communication efforts at Faceb...View more
Contents Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
Charlotte M. Reed received the B.S. degree in education from Carlow College, Carlow, Ireland, in 1969 and the Ph.D. degree in bioacoustics from the University of Pittsburgh, Pittsburgh, PA, USA, in 1973. She is currently a Senior Research Scientist with the Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA.
Charlotte M. Reed received the B.S. degree in education from Carlow College, Carlow, Ireland, in 1969 and the Ph.D. degree in bioacoustics from the University of Pittsburgh, Pittsburgh, PA, USA, in 1973. She is currently a Senior Research Scientist with the Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Hong Z. Tan received the bachelor's degree in biomedical engineering from Shanghai Jiao Tong University, Shanghai, China, in 1986, and the master's degree in electrical engineering and the doctorate degree in computer science from the Massachusetts Institute of Technology, Cambridge, MA, USA, in 1988 and 1996, respectively. She is currently a Professor of electrical and computer engineering, mechanical engineerg (by courtesy), and psychological sciences (by courtesy) with Purdue University, West Lafayette, IN, USA. She was an Associate Editor of the IEEE Transactions on Haptics from 2007 to 2012 and since 2016. She received a Meritorious Service Award in 2012.
Hong Z. Tan received the bachelor's degree in biomedical engineering from Shanghai Jiao Tong University, Shanghai, China, in 1986, and the master's degree in electrical engineering and the doctorate degree in computer science from the Massachusetts Institute of Technology, Cambridge, MA, USA, in 1988 and 1996, respectively. She is currently a Professor of electrical and computer engineering, mechanical engineerg (by courtesy), and psychological sciences (by courtesy) with Purdue University, West Lafayette, IN, USA. She was an Associate Editor of the IEEE Transactions on Haptics from 2007 to 2012 and since 2016. She received a Meritorious Service Award in 2012.View more
Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
Zach Perez received the bachelor's degree in chemistry from the Massachusetts Institute of Technology, Cambridge, MA, USA, in 2005 and the Juris Doctor degree from the Georgetown University Law Center, Washington, DC, USA, in 2012. He is currently a Senior Research Support Associate with the Research Laboratory of Electronics, Massachusetts Institute of Technology.
Zach Perez received the bachelor's degree in chemistry from the Massachusetts Institute of Technology, Cambridge, MA, USA, in 2005 and the Juris Doctor degree from the Georgetown University Law Center, Washington, DC, USA, in 2012. He is currently a Senior Research Support Associate with the Research Laboratory of Electronics, Massachusetts Institute of Technology.View more
Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
E. Courtenay Wilson received the B.S. degree in computer science and engineering from the University of Connecticut, Storrs, CT, USA, in 1994, the M.S. degree in computer engineering from the University of Nevada, Reno, NV, USA, in 2001, and the Ph.D. degree in speech and hearing bioscience and technology from the Massachusetts Institute of Technology (MIT), Cambridge, MA, USA, in 2010. She is currently a Researcher with MIT and a Lecturer with the Math Department, Northeastern University, Shenyang, China.
E. Courtenay Wilson received the B.S. degree in computer science and engineering from the University of Connecticut, Storrs, CT, USA, in 1994, the M.S. degree in computer engineering from the University of Nevada, Reno, NV, USA, in 2001, and the Ph.D. degree in speech and hearing bioscience and technology from the Massachusetts Institute of Technology (MIT), Cambridge, MA, USA, in 2010. She is currently a Researcher with MIT and a Lecturer with the Math Department, Northeastern University, Shenyang, China.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Frederico M. Severgnini received the B.A.Sc. degree in electronic and telecommunication engineering from PUC Minas University, Belo Horizonte, Brazil, in 2015 and the M.S. degree in electrical and computer engineering from Purdue University, West Lafayette, IN, USA, in 2018. He was a Graduate Research Assistant with the Haptic Interface Research Lab advised by Dr. H. Z. Tan.
Frederico M. Severgnini received the B.A.Sc. degree in electronic and telecommunication engineering from PUC Minas University, Belo Horizonte, Brazil, in 2015 and the M.S. degree in electrical and computer engineering from Purdue University, West Lafayette, IN, USA, in 2018. He was a Graduate Research Assistant with the Haptic Interface Research Lab advised by Dr. H. Z. Tan.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Jaehong Jung is working toward the B.S. degree in the School of Mechanical Engineering, Purdue University, West Lafayette, IN, USA. He is an Undergraduate Research Assistant with the Haptic Interface Research Lab, Purdue University, under the supervision of Dr. H. Z. Tan.
Jaehong Jung is working toward the B.S. degree in the School of Mechanical Engineering, Purdue University, West Lafayette, IN, USA. He is an Undergraduate Research Assistant with the Haptic Interface Research Lab, Purdue University, under the supervision of Dr. H. Z. Tan.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Juan S. Martinez received the B.A.Sc. degrees in electronic engineering and systems and computer engineering from Los Andes University, Bogota, Colombia, in 2016 and 2017, respectively. He is currently working toward the M.S. degree at Purdue University, West Lafayette, IN, USA, where he is a Research Assistant in the Haptic Interface Research Lab, advised by Dr. H. Z. Tan.
Juan S. Martinez received the B.A.Sc. degrees in electronic engineering and systems and computer engineering from Los Andes University, Bogota, Colombia, in 2016 and 2017, respectively. He is currently working toward the M.S. degree at Purdue University, West Lafayette, IN, USA, where he is a Research Assistant in the Haptic Interface Research Lab, advised by Dr. H. Z. Tan.View more
Haptic Interface Research Laboratory, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Yang Jiao received the B.E. degree in electronic information science and technology from the Beijing University of Posts and Telecommunications, Beijing, China, in 2009, the M.S. degree in wireless communications from the University of Southampton, Southampton, U.K., in 2010, and the Ph.D. degree in design from Tsinghua University, Beijing, China, in 2017. He is currently a Postdoctoral Research Associate at Purdue University, West Lafayette, IN, USA.
Yang Jiao received the B.E. degree in electronic information science and technology from the Beijing University of Posts and Telecommunications, Beijing, China, in 2009, the M.S. degree in wireless communications from the University of Southampton, Southampton, U.K., in 2010, and the Ph.D. degree in design from Tsinghua University, Beijing, China, in 2017. He is currently a Postdoctoral Research Associate at Purdue University, West Lafayette, IN, USA.View more
Facebook Inc., Menlo Park, CA, USA
Ali Israr received the B.S. degree in mechanical engineering from the University of Engineering & Technology, Lahore, Pakistan, and the M.S. and Ph.D. degrees in mechanical engineering from Purdue University, West Lafayette, IN, USA.
Ali Israr received the B.S. degree in mechanical engineering from the University of Engineering & Technology, Lahore, Pakistan, and the M.S. and Ph.D. degrees in mechanical engineering from Purdue University, West Lafayette, IN, USA.View more
Facebook Inc., Menlo Park, CA, USA
Frances Lau received the B.A.Sc. degree in electrical engineering from the University of Toronto, Toronto, ON, Canada, in 2005, and the M.S. and Ph.D. degrees in electrical engineering from Stanford University, Stanford, CA, USA, in 2007 and 2013, respectively. She is currently working on research and development of haptic communication systems at Facebook, Menlo Park, CA, USA.
Frances Lau received the B.A.Sc. degree in electrical engineering from the University of Toronto, Toronto, ON, Canada, in 2005, and the M.S. and Ph.D. degrees in electrical engineering from Stanford University, Stanford, CA, USA, in 2007 and 2013, respectively. She is currently working on research and development of haptic communication systems at Facebook, Menlo Park, CA, USA.View more
Facebook Inc., Menlo Park, CA, USA
Keith Klumb received the bachelor's degree in electrical engineering technology from Purdue Unviersity, West Lafayette, IN, USA, in 2001. He is currently a Research Program Manager with Facebook, Menlo Park, CA, USA.
Keith Klumb received the bachelor's degree in electrical engineering technology from Purdue Unviersity, West Lafayette, IN, USA, in 2001. He is currently a Research Program Manager with Facebook, Menlo Park, CA, USA.View more
Facebook Inc., Menlo Park, CA, USA
Robert Turcott received the Ph.D. degree in electrical engineering with a focus on signal processing from Columbia University, New York, NY, USA, and the M.D. degree from Stanford University, Stanford, CA, USA. When he is not practicing cardiology, he serves as a consultant in the medical device and technology industries.
Robert Turcott received the Ph.D. degree in electrical engineering with a focus on signal processing from Columbia University, New York, NY, USA, and the M.D. degree from Stanford University, Stanford, CA, USA. When he is not practicing cardiology, he serves as a consultant in the medical device and technology industries.View more
Facebook Inc., Menlo Park, CA, USA
Freddy Abnousi received the M.D. degree from the Stanford University School of Medicine, Stanford, CA, USA, the M.B.A. degree from Oxford University, Oxford, U.K., and the M.Sc. degree in health policy, planning, and financing from the London School of Economics, London, U.K. He is an interventional cardiologist specializing in coronary and structural interventions. He currently leads haptic communication efforts at Facebook's Building 8.
Freddy Abnousi received the M.D. degree from the Stanford University School of Medicine, Stanford, CA, USA, the M.B.A. degree from Oxford University, Oxford, U.K., and the M.Sc. degree in health policy, planning, and financing from the London School of Economics, London, U.K. He is an interventional cardiologist specializing in coronary and structural interventions. He currently leads haptic communication efforts at Facebook's Building 8.View more
