Integrating HPC into Radio-Astronomical data reduction

The construction of the SKA and its pathfinders puts significant computational and power consumption constraints on the design of the computer hardware. However, hardware is only one aspect of the problem space, even if extremely fast and power efficient computers were available today, we still could not process the data coming from the SKA due to its volume and the time critical nature of the results. This talk outlines the challenges in the areas of: data flow; storage design and optimisation; database integration into HPC; and low-latency scheduling for ultrascale visualisation and analysis on HPC systems.