A Publish–Subscribe Approach for Efficient Earth Observation Data Distribution and Acquisition

In the big data era, efficient and scalable methods for distributing and acquiring vast amounts of Earth Observation (EO) data in a timely manner are crucial for scientific research, weather prediction, disaster and emergency response, environmental monitoring, and various other applications. The Publish–Subscribe (Pub-Sub) approach promotes a decoupled architecture to facilitate communications between services and applications. This paper explores this approach as a reliable and flexible solution to address the challenges of EO data distribution and acquisition, and presents the implementation of combining cloud computing services of Amazon Web Services (AWS), the RabbitMQ open source message-broker software, and the GoLang programming language to build an event driven framework, which results in more efficient EO data transmission, distributed resource utilization, and less data latency.