From characters to words: dynamical segmentation and predictive neural networks

We present the extension of a neural predictive system primitively designed for on-line character recognition to words. Feature extraction is performed after resampling the pen trajectory information, recorded by a digitizing tablet. Each word is modeled by the natural concatenation of letter-models corresponding to the letters composing it. Successive parts of a word trajectory are this way modeled by different neural networks and only transitions from each one to itself or to its right neighbors are permitted. A holistic and dynamical segmentation allows one to adjust letter-models to the great variability of handwriting encountered in the words. Our system combines multilayer neural networks and dynamic programming with an underlying left-right hidden Markov model (HMM). Training was performed on 7000 words from 9 writers, leading to good results in the letter-labelling process, without using any language model.