OpenCL Runtime for OS-Driven Task Pipelining on Heterogeneous Accelerators

Task pipelining on accelerators is suitable for streaming applications, while its performance can decrease due to frequent user/OS interactions caused by hardware control via device drivers. Our previous research has proposed PPM, an OS support that efficiently manages multiple accelerators by eliminating the user/OS interactions during the pipelined execution. To allow users to develop and execute pipeline applications using PPM, this paper introduces a customized OpenCL runtime library. When executing an OpenCL application, the runtime library dynamically analyzes OpenCL API calls and creates a data flow graph required for the PPM execution. With the runtime library, users easily execute applications written in common OpenCL pipeline model on PPM.