Cell/B.E. based on-line multi-view broadcasting system

Cell/B.E. multi-view system consists of multi-view capturing, view synthesis and 3D finger tracking. It's an on-line image-based multi-view broadcasting system. Input images are obtained by the multi-view capturing and the viewpoint is determined by the finger tracking. View synthesis is to render the desired viewpoint image. In order to build a system with high performance and scalability, IBM Cell/B.E. multiprocessor plays an important role in the system. The algorithms of view synthesis and finger tracking are optimized for the Cell/B.E. blade server. Fifteen blades are pipelined in the prototype system where parallel architecture and data parallelism are designed in the proposed system. Synchronized high-resolution multi-view capturing, frame-based pipelined view synthesis and 3D finger tracking are implemented. Finger tracking can achieve 600fps and view synthesis can be completed in 67fps, but overall performance is around 800times600@15fps due to the limitation of data transmission and PC performance.