Real-time signal identification in big data streams Bragg-Spot localization in photon science

The next generation of photon science experiments will be able to produce thousands of images per second. However, many of them will not be useful for further analysis. Due to this large amount of data, it is not feasible to store all data offline for later analysis. Instead, this analysis has to be shifted as close to the data sources as possible. In addition, due to the large volume and velocity of the data, this analysis has to be done highly parallel. In this article we recapitulate our previous work on algorithms on data analysis in photon science as well as the potentially relevant BM3D algorithm. These algorithms are discussed with a focus on their parallel processing capabilities.