Fusion Mechanisms for Human Activity Recognition Using Automated Machine Learning | IEEE Journals & Magazine | IEEE Xplore

Fusion Mechanisms for Human Activity Recognition Using Automated Machine Learning

CodeAvailable

0 seconds of 0 secondsVolume 90%
Press shift question mark to access a list of keyboard shortcuts
Keyboard Shortcuts
Play/PauseSPACE
Increase Volume
Decrease Volume
Seek Forward
Seek Backward
Captions On/Offc
Fullscreen/Exit Fullscreenf
Mute/Unmutem
Seek %0-9
00:00
00:00
00:00
 
Human activity recognition using automated machine learning method: information from all channels of a 3D video (RGB and depth data, skeleton and context objects) is merg...

Abstract:

Human activity recognition has been a branch of interest in the field of computer vision for decades, due to its numerous applications in different domains, such as medic...Show More

Abstract:

Human activity recognition has been a branch of interest in the field of computer vision for decades, due to its numerous applications in different domains, such as medicine, surveillance, entertainment or human-computer interaction. We propose an intuitive, effective, quickly trainable and customizable system for recognizing human activities designed with an automated machine learning method based on Neural Architecture Search. Information from all channels of a 3D video (RGB and depth data, skeleton and context objects) is merged by independently passing these data streams through 2D convolutional neural networks. The outputs of all networks are combined in a summarizing array of class scores using fusion mechanisms that are not computationally intensive but reflect the meaningful information from a video. The proposed system is tested using three public datasets and a new dataset—PRECIS HAR—that was created in our laboratory. In all our experiments, the system is proven to be highly accurate: 98.43% on MSRDailyActivity3D, 91.41% on UTD-MHAD, 90.95% on NTU RGB+D, and 94.38% on our dataset.
0 seconds of 0 secondsVolume 90%
Press shift question mark to access a list of keyboard shortcuts
Keyboard Shortcuts
Play/PauseSPACE
Increase Volume
Decrease Volume
Seek Forward
Seek Backward
Captions On/Offc
Fullscreen/Exit Fullscreenf
Mute/Unmutem
Seek %0-9
00:00
00:00
00:00
 
Human activity recognition using automated machine learning method: information from all channels of a 3D video (RGB and depth data, skeleton and context objects) is merg...
Published in: IEEE Access ( Volume: 8)
Page(s): 143996 - 144014
Date of Publication: 31 July 2020
Electronic ISSN: 2169-3536

Funding Agency:


References

References is not available for this document.