Design of big data integration platform based on hybrid hierarchy architecture

As the exponential growth of data in internet era, the era of big data is coming. Big data integration creates huge values that makes it a research hotspot. However, in big data era, data shows characters of large volume, velocity, veracity and especially variety which is also called heterogeneity. Multiple different sources of data lead to data heterogeneity. Multi-source heterogeneous data brings challenges to big data integration. In this paper, we proposes a big data integration platform based on hybrid hierarchy architecture, which classifies the underlying multi-source heterogeneous data sources according to themes, and uses the data warehouse as the middle-tier data source. Then user uses the mediator to directly access the middle-tier data source through pattern mapping. Experiments show that compared with the traditional method of directly connecting the underlying data source, this data integration platform improves query performance.