Trainable Cantonese/English dual language speech synthesis system

The paper introduces a Cantonese/English dual language text to speech (TTS) system. It was developed on IBM's trainable TTS technology, which uses trainable statistical models to automate speech data processing and selection. The Cantonese and English phonological, syntactic and prosodic rules were built into a dual-language delta module, which processes the mixed-language input accordingly and generates mixed Cantonese and English speech with coherent prosody. To approximate the speaker's characteristics, a speaker prosody profile was extracted from the dataset and incorporated into the delta speech rule processing for the enhancement of duration, lexical tone and intonation prediction. In the selection of the concatenative unit set, we experimented with different Cantonese syllable decomposition schemes. Though this system is currently only implemented for Cantonese, it can be easily adapted to other tonal languages.