An Open Job Scheduling Service for Large-Scale Data Processing

Scientific Data Grid (SDG) of Chinese Academy of Sciences aims at integrating distributed scientific data, providing transparent data access mechanism and efficient data analysis, processing and visualization services. SDG Job Scheduler (SDGJS) adopts an open and service-oriented framework. The scheduling policy of SDGJS considers both performance of computing nodes and distribution of large data so that it can achieve an efficient job processing. SDGJS has successfully served for some data grid applications.