Off-line handwritten word recognition using a mixed HMM-MRF approach

Presents a 2D stochastic method for the recognition of unconstrained handwritten words in a small lexicon. The method is based on an efficient combination of hidden Markov models (HMMs) and causal Markov random fields (MRFs). It operates in a holistic manner, at the pixel level, on scaled binary word images which are assumed to be random field realizations. The state-related random fields act as smooth local estimators of specific writing strokes by merging conditional pixel probabilities along the columns of the image. The HMM component of our model provides an optimal switching mechanism between sets of MRF distributions in order to dynamically adapt to the features encountered during the left-to-right image scan. Experiments performed on a French omni-scriptor, an omni-bank database of handwritten legal check amounts provided by the A2iA company, are described in great extent.