By Topic

Network grafting: Transferring learned features from trained neural networks

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Yang Li ; Tsinghua National Laboratory for Information Science and Technology (TNList), State Key Laboratory on Microwave and Digital Communications, Dept. of Electronic Engineering, Tsinghua University, Beijing 100084, China ; Xiaoming Tao ; Jianhua Lu

The degree of abundance of labeled training data is an important factor in determining the performance of supervised machine learning systems. However, in some applications, labeled data are either costly to collect or easily outdated, resulting in poor generalization of trained machine learners. Nonetheless, there are often related domains where large corpuses of labeled data can be easily obtained. Therefore, we propose a new transfer learning algorithm to adapt a neural network trained on such a related domain to the target domain by grafting additional nodes onto its hidden layer. This neural grafting method is capable of transfering the knowledge embedded in the structures of the trained neural network to the problem in the target domain. Experiments on synthesized and real data sets show that grafted networks achieve good performance with very small amounts of data from the target domain. Compared with existing transfer learning techniques, the proposed neural grafting is easy to tune and computationally simple, with superior performance.

Published in:

Computational Intelligence and Cybernetics (CyberneticsCom), 2012 IEEE International Conference on

Date of Conference:

12-14 July 2012