By Topic

An MAS-based and fault-tolerant distributed ETL workflow engine

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Jinluan Huang ; Department of Computer Science and Technology, Fuzhou University, Fujian, China ; Chaozhen Guo

To improve the stability and reliability of the ETL workflow engine, in this paper, we put forward a new MAS-based and fault-tolerant distributed ELT workflow engine which is used to study the log management and exception handling mechanism in the distributed computing environment. In the new engine, the ETL jobs will be split into several job domains firstly. Secondly, when an error happens in a job domain, the engine will catch the exception from the error logs and then invoke our new recovery algorithm, Batch, to recover the job domain. The experiment result shows that our engine is not only much more stabile and reliable but also more efficiency in the execution of ETL workflow.

Published in:

Computer Supported Cooperative Work in Design (CSCWD), 2012 IEEE 16th International Conference on

Date of Conference:

23-25 May 2012