Discovery and segmentation of activities in video
Brand, M.
Kettnaker, V.
Mitsubishi Electr. Res. Labs., Cambridge, MA;
This paper appears in: Pattern Analysis and Machine Intelligence, IEEE Transactions on
Publication Date: Aug 2000
Volume: 22,
Issue: 8
On page(s): 844-851
ISSN: 0162-8828
References Cited: 18
CODEN: ITPIDJ
INSPEC Accession Number: 6744976
Digital Object Identifier: 10.1109/34.868685
Current Version Published: 2002-08-06
Abstract
Hidden Markov models (HMMs) have become the workhorses of the
monitoring and event recognition literature because they bring to
time-series analysis the utility of density estimation and the
convenience of dynamic time warping. Once trained, the internals of
these models are considered opaque; there is no effort to interpret the
hidden states. We show that by minimizing the entropy of the joint
distribution, an HMM's internal state machine can be made to organize
observed activity into meaningful states. This has uses in video
monitoring and annotation, low bit-rate coding of scene activity, and
detection of anomalous behavior. We demonstrate with models of office
activity and outdoor traffic, showing how the framework learns principal
modes of activity and patterns of activity change. We then show how this
framework can be adapted to infer hidden state from extremely ambiguous
images, in particular, inferring 3D body orientation and pose from
sequences of low-resolution silhouettes
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.