Benchmarking technology for configurable computing system

This paper presents benchmarking technology for assessing configurable computing systems. An important goal of this technology is to provide benchmarks that expose as much information as possible about configurable computing system's infrastructure, both tools and architecture. The intent of these benchmarks is not solely to compare competing architectures, but rather to provide insight regarding specific properties of configurable computing systems. The benchmarking technology leverages the work performed in the C/sup 3/I Parallel Benchmark Suite (C3IPBS) program, which addressed the development of a suite of benchmarks for a variety of critical C/sup 3/I applications on various parallel machines. Several benchmarking concepts from the C3IPBS program have been applied to the domain of configurable computing, such as the development of a benchmarking methodology, benchmarking procedures, unbiased specifications, and acceptance tests for ensuring that an implementation satisfies a benchmark specification.