SimMapReduce: A Simulator for Modeling MapReduce Framework

As a parallel programming framework, MapReduce has attracted more and more attention from both IT enterprises and research institutes that work for large dataset processing. SimMapReduce, a MapReduce simulator based on Grid Sim, is introduced to facilitate research on resource management and performance evaluation. With SimMapReduce simulator, researchers are free to implement scheduling algorithms and resource allocation policies by inheriting the provided java classes without concerns of implementation details. A File Manager is integrated to manage files transfers, so that the file transmission time is recorded and taken into account as a part of job completion time. Different simulation scenarios are modeled by predefining parameters in a configuration file. Experiment results illustrate that SimMapReduce can be easily executed in a personal computer and can provide qualitative analysis for MapReduce systems.