Implementation of Hyperparameter Algorithms on Big Data Platforms: A Case Study

Algorithms in each step of data analytics application include hyperparameters which are independent of the data itself. The choice of hyperparameters is one of the most time consuming part of data analytics, since it cannot be performed precisely without the use of heuristic or empirical methods. In our project we have implemented hyperparameter selection algorithms: Simulated Annealing, Bayesian Search, Tree-structured Parzen Estimators, Differential Evolution, Basin Hopping on Spark, distributed big data processing platform. The performance is measured by comparing results we get from each algorithm with results of Random Search algorithm. We have tested the scalability and ability for parallelization of algorithms.