Reference architecture for search infrastructure

Cloud, Micro-service, World Wide Web, big data spill of a huge amount of data. Collecting data from multiple sources and putting into a unified silo is now a common practice. From there, we perform analytics, statistics, trends, or behavioral analysis to expose hidden information within. There is a vital need to retrieve these voluminous data in a quick way. Search Engine can solve this. This paper discusses several use case of Search Engine in recent trends. We explain the history of Search Engine, how data movement and possible requirement consideration in hosting a search infrastructure. A reference architecture is provided to guide the user in understanding how to acquire data and retrieve data using Search Engine. The presented work is intended to provide a bird's eye view on how search can be integrated benefited into the existing application system.