By Topic

Naive Support Vector Regression and Multilayer Perceptron benchmarks for the 2010 neural network grand competition (NNGC) on time series prediction

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Crone, S.F. ; Manage. Sch., Dept. of Manage. Sci., Lancaster Univ., Lancaster, UK ; Kourentzes, N.

In recent forecasting competitions, algorithms of Support Vector Regression (SVR) and Neural Networks (NN) have provided some of the most accurate time series predictions, but also some of the least accurate contenders failing to outperform even simple statistical benchmark methods. As both SVR and NN offer substantial degrees of freedom in model building (e.g. selecting input variables, kernel or activation functions, etc.), a myriad of heuristics and ad-hoc rules have emerged which may lead to different models with substantial differences in performance. The heterogeneity of results impairs our ability to compare the adequacy of a class of algorithms for a given dataset, and fails to develop an understanding of their presumed nonlinear and non-parametric capabilities. In order to determine a generalized estimate of performance for both SVR and NN in the absence of an accepted `best practice' methodology, this paper seeks to compute benchmark results employing a naïve methodology which attempts to mimic many of the common mistakes in model building. The naive methodologies serve primarily as a lower error bound, representative of a within class benchmark for both algorithms in predicting the 66 time series of the NNGC Competition. In addition, their discussion aims to draw attention to the most common mistakes in modelling that regularly lead to model misspecification of MLPs and SVRs in time series forecasting.

Published in:

Neural Networks (IJCNN), The 2010 International Joint Conference on

Date of Conference:

18-23 July 2010