With the great progress of the Information Technologies, micro-processors are embedded into everywhere to make our daily life convenient, efficient and comfortable. However, how to integrate distributed resources existing among heterogeneous devices to build pervasive applications that can constantly adapt to the highly dynamic computing environment is still a challenge. On our previous work, by analyzing the pipelining feature within a user task and exploiting the parallelism among the ubiquitous processors, we have proposed UMP-Percomp, which is a ubiquitous multiprocessor-based pipeline processing architecture to support high performance pervasive application development. As a case study of the UMP (ubiquitous multi-processor) system, we have implemented a prototype system of the JPEG encoding. In this research, we have studied three different scheduling policies to the prototype system and proposed the best architecture of the UMP system. We have also introduced the cache technology to the proposed resource allocation algorithm. To prove our ideas, a simulation based system was implemented. The experience results revealed that the proposed algorithms made a significant progress over the existing solution.