Action Recognition Online with Hierarchical Self-Organizing Maps

We present a hierarchical self-organizing map based system for online recognition of human actions. We have made a first evaluation of our system by training it on two different sets of recorded human actions, one set containing manner actions and one set containing result actions, and then tested it by letting a human performer carry out the actions online in real time in front of the system's 3D-camera. The system successfully recognized more than 94% of the manner actions and most of the result actions carried out by the human performer.