Big Data Analysis in Astronomy by the Lemur Software

A very quick progress in information technologies as well as the telescope creation technologies produce a big volume of astronomical big data as well as high dimensional information. All such big data are needed to be analyzed and reviewed in time. But in astronomy such big data can be received in both in the real-time/online mode and from the historical archives. In this paper we have presented the several aspects of the analysis process of such big astronomical data. We have reviewed them and provided some global approaches for the big astronomical data analysis. Also, we have presented examples of sources for big data, different astronomical instruments, big telescopes, different data processing methods and algorithms that are used for the big data analysis process in astronomy. The paper describes an applying of the different data processing methods and algorithms adopted to the various types of astronomical information in scope of the Collection Light Technology (CoLiTec) project. During this research the Lemur software was developed for the online processing and analysis of the big volume of the astronomical big data. The especial OnLine Data Analysis System (OLDAS) mode was created for resolving the different tasks during astronomical big data analysis and processing, like preparation, extracting, classification, preprocessing, clustering, data mining, transforming, image processing, etc.