RF-CSign: A Chinese Sign Language Recognition System Based on Large Kernel Convolution and Normalization-Based Attention | IEEE Journals & Magazine | IEEE Xplore

RF-CSign: A Chinese Sign Language Recognition System Based on Large Kernel Convolution and Normalization-Based Attention

DatasetsAvailable

By constructing a signal perception model, Chinese sign language actions are made between antenna-tag layouts. The phase is used as the original signal, and the phase sig...

Abstract:

Hearing impaired people use sign language for communication, which relies on the movement gestures of body parts and plays a vital role in human-computer interaction. Mos...Show More

Abstract:

Hearing impaired people use sign language for communication, which relies on the movement gestures of body parts and plays a vital role in human-computer interaction. Most wireless sensing-based gesture recognition studies have recognized simple gestures but overlooked the recognition of complex activities, such as sign language. In addition, cross-domain recognition often requires a large amount of data to train classifiers for each environment. Therefore, we propose RF-CSign, which aims to achieve high accuracy in sign language recognition and cross-domain recognition. First, we use Radio Frequency Identification (RFID) to collect signals and obtain denoised signals through data pre-processing, so that they can be processed in a neural network. Second, the RF-CSign network is proposed with the inclusion of large kernel convolution to reduce the complexity of the model and to make the model with long-range correlations, thereby enhancing recognition accuracy. Third, RF-CSign employs a pixel Normalization-based Attention Module (NAM) to enhance the stability of the model, thereby addressing the problem of model overfitting. Finally, RF-CSign achieves high accuracy in cross-domain environments through a migration learning approach. The experimental results showed that the average recognition accuracy of RF-CSign reached 99.17%, and the average recognition accuracy for new users and new environments recorded 96.67% and 97.50%, respectively.
By constructing a signal perception model, Chinese sign language actions are made between antenna-tag layouts. The phase is used as the original signal, and the phase sig...
Published in: IEEE Access ( Volume: 11)
Page(s): 133767 - 133780
Date of Publication: 15 November 2023
Electronic ISSN: 2169-3536

Funding Agency:

Author image of Huanyuan Xu
School of Software, Xinjiang University, Xinjiang, Ürümqi, China
Huanyuan Xu was born in Zhanjiang, Guangdong, China, in 1997. He received the B.S. degree in optoelectronic information science and engineering from Qingdao University, China, in 2020. He is currently pursuing the master’s degree in software engineering with Xinjiang University, China. His research interests include computer vision, pattern recognition, and signal processing.
Huanyuan Xu was born in Zhanjiang, Guangdong, China, in 1997. He received the B.S. degree in optoelectronic information science and engineering from Qingdao University, China, in 2020. He is currently pursuing the master’s degree in software engineering with Xinjiang University, China. His research interests include computer vision, pattern recognition, and signal processing.View more
Author image of Yajun Zhang
School of Software, Xinjiang University, Xinjiang, Ürümqi, China
Yajun Zhang was born in Nanyang, Henan, China, in 1983. He received the B.S. and master’s degrees from Xinjiang University, China, in 2007 and 2010, respectively. He is currently an Associate Professor with Xinjiang University. His research interests include indoor localization technology, pattern recognition, and signal processing.
Yajun Zhang was born in Nanyang, Henan, China, in 1983. He received the B.S. and master’s degrees from Xinjiang University, China, in 2007 and 2010, respectively. He is currently an Associate Professor with Xinjiang University. His research interests include indoor localization technology, pattern recognition, and signal processing.View more
Author image of Zhixiong Yang
School of Future Technology, Xinjiang University, Xinjiang, Ürümqi, China
Zhixiong Yang was born in Ningde, Fujian, China, in 1998. He received the bachelor’s degree in software engineering from the Changchun University of Science and Technology, China, in 2019. He is currently pursuing the Ph.D. degree in computer science and technology with Xinjiang University, China. His research interests include indoor positioning techniques, pattern recognition, and signal processing.
Zhixiong Yang was born in Ningde, Fujian, China, in 1998. He received the bachelor’s degree in software engineering from the Changchun University of Science and Technology, China, in 2019. He is currently pursuing the Ph.D. degree in computer science and technology with Xinjiang University, China. His research interests include indoor positioning techniques, pattern recognition, and signal processing.View more
Author image of Haoqiang Yan
School of Software, Xinjiang University, Xinjiang, Ürümqi, China
Haoqiang Yan was born in Karamay, Xinjiang, China, in 1997. He received the B.S. degree in software engineering from Southwest Petroleum University, China, in 2019. He is currently pursuing the master’s degree in software engineering with Xinjiang University, Xinjiang. His research interests include deep learning, pattern recognition, and signal processing.
Haoqiang Yan was born in Karamay, Xinjiang, China, in 1997. He received the B.S. degree in software engineering from Southwest Petroleum University, China, in 2019. He is currently pursuing the master’s degree in software engineering with Xinjiang University, Xinjiang. His research interests include deep learning, pattern recognition, and signal processing.View more
Author image of Xingqiang Wang
School of Software, Xinjiang University, Xinjiang, Ürümqi, China
Xingqiang Wang was born in Tai’an, Shandong, China, in 1999. He received the B.S. degree in computer science and technology from Anhui University, China, in 2021. He is currently pursuing the master’s degree in software engineering with Xinjiang University, China. His research interests include pattern recognition and signal processing.
Xingqiang Wang was born in Tai’an, Shandong, China, in 1999. He received the B.S. degree in computer science and technology from Anhui University, China, in 2021. He is currently pursuing the master’s degree in software engineering with Xinjiang University, China. His research interests include pattern recognition and signal processing.View more

Author image of Huanyuan Xu
School of Software, Xinjiang University, Xinjiang, Ürümqi, China
Huanyuan Xu was born in Zhanjiang, Guangdong, China, in 1997. He received the B.S. degree in optoelectronic information science and engineering from Qingdao University, China, in 2020. He is currently pursuing the master’s degree in software engineering with Xinjiang University, China. His research interests include computer vision, pattern recognition, and signal processing.
Huanyuan Xu was born in Zhanjiang, Guangdong, China, in 1997. He received the B.S. degree in optoelectronic information science and engineering from Qingdao University, China, in 2020. He is currently pursuing the master’s degree in software engineering with Xinjiang University, China. His research interests include computer vision, pattern recognition, and signal processing.View more
Author image of Yajun Zhang
School of Software, Xinjiang University, Xinjiang, Ürümqi, China
Yajun Zhang was born in Nanyang, Henan, China, in 1983. He received the B.S. and master’s degrees from Xinjiang University, China, in 2007 and 2010, respectively. He is currently an Associate Professor with Xinjiang University. His research interests include indoor localization technology, pattern recognition, and signal processing.
Yajun Zhang was born in Nanyang, Henan, China, in 1983. He received the B.S. and master’s degrees from Xinjiang University, China, in 2007 and 2010, respectively. He is currently an Associate Professor with Xinjiang University. His research interests include indoor localization technology, pattern recognition, and signal processing.View more
Author image of Zhixiong Yang
School of Future Technology, Xinjiang University, Xinjiang, Ürümqi, China
Zhixiong Yang was born in Ningde, Fujian, China, in 1998. He received the bachelor’s degree in software engineering from the Changchun University of Science and Technology, China, in 2019. He is currently pursuing the Ph.D. degree in computer science and technology with Xinjiang University, China. His research interests include indoor positioning techniques, pattern recognition, and signal processing.
Zhixiong Yang was born in Ningde, Fujian, China, in 1998. He received the bachelor’s degree in software engineering from the Changchun University of Science and Technology, China, in 2019. He is currently pursuing the Ph.D. degree in computer science and technology with Xinjiang University, China. His research interests include indoor positioning techniques, pattern recognition, and signal processing.View more
Author image of Haoqiang Yan
School of Software, Xinjiang University, Xinjiang, Ürümqi, China
Haoqiang Yan was born in Karamay, Xinjiang, China, in 1997. He received the B.S. degree in software engineering from Southwest Petroleum University, China, in 2019. He is currently pursuing the master’s degree in software engineering with Xinjiang University, Xinjiang. His research interests include deep learning, pattern recognition, and signal processing.
Haoqiang Yan was born in Karamay, Xinjiang, China, in 1997. He received the B.S. degree in software engineering from Southwest Petroleum University, China, in 2019. He is currently pursuing the master’s degree in software engineering with Xinjiang University, Xinjiang. His research interests include deep learning, pattern recognition, and signal processing.View more
Author image of Xingqiang Wang
School of Software, Xinjiang University, Xinjiang, Ürümqi, China
Xingqiang Wang was born in Tai’an, Shandong, China, in 1999. He received the B.S. degree in computer science and technology from Anhui University, China, in 2021. He is currently pursuing the master’s degree in software engineering with Xinjiang University, China. His research interests include pattern recognition and signal processing.
Xingqiang Wang was born in Tai’an, Shandong, China, in 1999. He received the B.S. degree in computer science and technology from Anhui University, China, in 2021. He is currently pursuing the master’s degree in software engineering with Xinjiang University, China. His research interests include pattern recognition and signal processing.View more

References

References is not available for this document.