Ensemble Transfer Learning for Time Series Forecasting: a Sensitivity Analysis Framework for a Shallow Neural Network

Transfer learning applied to time-series forecasting is a current topic of high interest to the machine learning community. This paper addresses the need for empirical studies, as identified in recent survey papers that advocate the necessity of practical guidelines for TL approaches and method design for time series forecasting. This paper's main contributions include proposing a comprehensive sensitivity analysis framework and methodology for TL schemes, starting with the introduction of four novel TL performance metrics. Our experiments validate the usability of the methodology and offer insightful information using an MLP shallow network as a use-case scenario. The results of the experiments demonstrate the advantages of using ensemble techniques for time series forecasting over using single models in transfer learning. The experiments also offer empirical insights into various parameters that impact the transfer learning gain while raising the question of network dimensioning requirements when designing a neural network for transfer learning. The project aims to culminate in the design of a pre-trained model that can benefit practitioners in time-series forecasting.