Parallel Computing: Review and Perspective

As parallelism on different levels becomes ubiquitous in today's computers, it seems worthwhile to provide a review of the wealth of every aspect of parallel computing that has evolved over the last decades. We refrain from a comprehensive survey and concentrate on parallel programming patterns, design for parallel program, parallel programming models, parallel programming languages, design of parallel algorithms, together with a perspective of parallel computing. Besides presenting the patterns, models, design frameworks, we also refer to languages, implementation, and tools.