In this paper, we propose a system for user directed real time view synthesis for hand-held devices. Stored image frames with corresponding depth maps are used as input to the system. Users view point choice is captured using a GYRO based system. OMAP3530 microprocessor is used as the main processor which processes suggested view synthesis algorithm with occlusion handling and frame enhancement techniques. Proposed algorithms are implemented on DSP core and ARM core of OMAP3530 separately and their performances are evaluated through experiments. In addition, two daughter cards are designed for user view point determination. First daughter card handles communication process with EVM board and calculates view point according to the input from the second daughter card with single axis response GYRO sensor (ADIS16060).