Big Data Processing System for Analysis of GitHub Events

The article describes architecture of a big data processing system based on Apache Hadoop, Apache Flume and Apache Spark toolset. Application of the developed system is shown for storage and analysis of dataset containing generated events within GitHub repository - the world’s largest web-service for version control using Git. System performance results are evaluated using chosen metrics.