Markov random field models for natural language
Mark, K.E.; Miller, M.I.; Grenander, U.
Information Theory, 1995. Proceedings., 1995 IEEE International Symposium on
Volume , Issue , 17-22 Sep 1995 Page(s):392 -
Digital Object Identifier 10.1109/ISIT.1995.550379
Summary:Markov chain (N-gram) source models for natural language were
explored by Shannon and have found wide application in speech
recognition systems. However, the underlying linear graph structure is
inadequate to express the hierarchical structure of language necessary
for encoding syntactic information. Context-free language models which
generate tree graphs are a natural way of encoding this information, but
lack the modeling of interword dependencies. We consider a hybrid
tree/chain graph structure which has the advantage of incorporating
lexical dependencies in syntactic representations. Two Markov random
field probability measures are derived on these tree/chain graphs from
the maximum entropy principle
View citation and abstract |