Automatic Tamil lyric generation based on image sequence and derived tune

The developed system is intended to generate Tamil lyrics from sequence of images, and derived tune. The choice of tune is automatically identified from the input situation and the notes are generated using a newly devised algorithm based on Carnatic music characteristics. The system, thus, generates two set of lyrics, based on the input: `Context (from Text) and Tune' and `Context (from text) and Image'. Image sequence helps in generating lyrics that are in accordance with the visual effects of the song. This is achieved by object extraction from the input images and location identification using a heuristic algorithm. Singable lyrics are generated by creating tune using Carnatic raga lakshanas which are its characteristics. An appropriate raga for the extracted emotion is determined by referring to a designed Raga-Emotion database. The raga characteristics are then used to synthesize notes leading to tune.