By Topic

Document Classification with Unsupervised Nonnegative Matrix Factorization and Supervised Percetron Learning

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Paresh Chandra Barman ; Brain Science Research Center, Dept. of BioSystems, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea, pcbarman@neuron.kaist.ac.kr ; Soo-Young Lee

A new hybrid neural network model is proposed for the document classification. The NMF-SLP model consists of 2 layers, in which the first non-negative matrix factorization (NMF) layer decomposes a document into several clusters, and the second single-layer-perceptron (SLP) layer classifies the document based on the clusters. The NMF layer is trained by factorizing the document word frequency matrix into feature matrix and coefficient matrix, and then estimating the pseudo-inverse of the feature matrix. The SLP layer is trained by standard error minimization algorithm. Classification performances are investigated as a function of the cluster number, i.e., the number of hidden neurons, and also slope of sigmoidal nonlinearity at the hidden neurons. The developed model demonstrates much better classification accuracy compared to the simple NMF and k-NN classifiers, while standard multi-layer Perceptron is almost impractical to train properly due to high dimensional inputs and large number of adaptive elements.

Published in:

2007 International Conference on Information Acquisition

Date of Conference:

8-11 July 2007