LSDStrategy: A Lightweight Software-Driven Strategy for Addressing Big Data Variety of Multimedia Streaming

Many devices, users, and applications stream an irregular amount of varied data every second. This rapid generation of data continues at an enormous rate, constructing the big data that increase the need for solutions, despite resource constraints, to analyze and manipulate data. Current methods allocate cloud resources according to the characteristics of the data. Resource allocation requires a comprehensive view of the workload requirements. However, the data characteristics in big data streams are uncertain due to the random nature of data generation. Choosing and allocating the right resources to this stream is challenging. With the variety of big data streams, the stochastic nature of the stream led to unpredictable requirements and specifications. The critical issue is forecasting the workload to avoid the over-provisioning and under-provisioning of resources. Such forecasting needs an adequate dataset to describe the history logs of the incoming workload. A fast release for such a dataset provides a high chance of deploying forecasting at the right time. This paper addresses this issue with a novel strategy named LSDStrategy that analyzes the received multimedia stream based on its binary content using machine learning techniques with artificial and real datasets. LSDStrategy utilizes an evaluating voting technique to select the optimum classifier to trade off accuracy and prediction time as metrics. Multi-classifiers that have been built and tested include Decision Tree (DT), K-Nearest Neighbor (K-NN), and Random Forest (RF) over multi-content-based features. Experiments evaluated the performance of the adopted models and the selected features. According to experimental analysis, the DT approach provides a consistent performance for both artificial and real-world datasets for 85% and 81.3%, respectively. We deploy and evaluate the LSDStrategy efficiency on a regular specification server through a set of experiments using a synthetic stream. The experiments prove the LSDStrategy agility and adaptivity in identifying the multimedia-based workload type utilizing small chunks of load.