Loading [MathJax]/extensions/MathMenu.js
Smoothness Regularized Multiview Subspace Clustering With Kernel Learning | IEEE Journals & Magazine | IEEE Xplore

Smoothness Regularized Multiview Subspace Clustering With Kernel Learning


Abstract:

Multiview subspace clustering has attracted an increasing amount of attention in recent years. However, most of the existing multiview subspace clustering methods assume ...Show More

Abstract:

Multiview subspace clustering has attracted an increasing amount of attention in recent years. However, most of the existing multiview subspace clustering methods assume linear relations between multiview data points when learning the affinity representation by means of the self-expression or fail to preserve the locality property of the original feature space in the learned affinity representation. To address the above issues, in this article, we propose a new multiview subspace clustering method termed smoothness regularized multiview subspace clustering with kernel learning (SMSCK). To capture the nonlinear relations between multiview data points, the proposed model maps the concatenated multiview observations into a high-dimensional kernel space, in which the linear relations reflect the nonlinear relations between multiview data points in the original space. In addition, to explicitly preserve the locality property of the original feature space in the learned affinity representation, the smoothness regularization is deployed in the subspace learning in the kernel space. Theoretical analysis has been provided to ensure that the optimal solution of the proposed model meets the grouping effect. The unique optimal solution of the proposed model can be obtained by an optimization strategy and the theoretical convergence analysis is also conducted. Extensive experiments are conducted on both image and document data sets, and the comparison results with state-of-the-art methods demonstrate the effectiveness of our method.
Published in: IEEE Transactions on Neural Networks and Learning Systems ( Volume: 32, Issue: 11, November 2021)
Page(s): 5047 - 5060
Date of Publication: 07 October 2020

ISSN Information:

PubMed ID: 33027007

Funding Agency:

Author image of Chang-Dong Wang
School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
Guangdong Province Key Laboratory of Computational Science, Yat-sen University, Guangzhou, China
Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Yat-sen University, Guangzhou, China
Chang-Dong Wang (Member, IEEE) received the Ph.D. degree in computer science from Sun Yat-sen University, Guangzhou, China, in 2013.
He was a Visiting Student with the University of Illinois at Chicago, Chicago, IL, USA, from January 2012 to November 2012. He joined Sun Yat-sen University in 2013, where he is currently an Associate Professor with the School of Data and Computer Science. His current research interests inclu...Show More
Chang-Dong Wang (Member, IEEE) received the Ph.D. degree in computer science from Sun Yat-sen University, Guangzhou, China, in 2013.
He was a Visiting Student with the University of Illinois at Chicago, Chicago, IL, USA, from January 2012 to November 2012. He joined Sun Yat-sen University in 2013, where he is currently an Associate Professor with the School of Data and Computer Science. His current research interests inclu...View more
Author image of Man-Sheng Chen
School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
Guangdong Province Key Laboratory of Computational Science, Yat-sen University, Guangzhou, China
Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Yat-sen University, Guangzhou, China
Man-Sheng Chen received the B.S. degree in computer science from South China Agricultural University, Guangzhou, China, in 2018. She is currently pursuing the master’s degree with Sun Yat-sen University, Guangzhou.
Her research interest is multiview clustering. She has published two articles in international conferences such as AAAI Conference on Artificial Intelligence (AAAI) and International Conference on Database Syste...Show More
Man-Sheng Chen received the B.S. degree in computer science from South China Agricultural University, Guangzhou, China, in 2018. She is currently pursuing the master’s degree with Sun Yat-sen University, Guangzhou.
Her research interest is multiview clustering. She has published two articles in international conferences such as AAAI Conference on Artificial Intelligence (AAAI) and International Conference on Database Syste...View more
Author image of Ling Huang
College of Mathematics and Informatics, South China Agricultural University, Guangzhou, China
Ling Huang (Member, IEEE) received the Ph.D. degree in computer science from Sun Yat-sen University, Guangzhou, China, in 2020.
She joined South China Agricultural University, Guangzhou, as an Associate Professor in 2020. She has published over ten articles in international journals and conferences such as the IEEE Transactions on Knowledge and Data Engineering (TKDE), the IEEE Transactions on Neural Networks and Learning ...Show More
Ling Huang (Member, IEEE) received the Ph.D. degree in computer science from Sun Yat-sen University, Guangzhou, China, in 2020.
She joined South China Agricultural University, Guangzhou, as an Associate Professor in 2020. She has published over ten articles in international journals and conferences such as the IEEE Transactions on Knowledge and Data Engineering (TKDE), the IEEE Transactions on Neural Networks and Learning ...View more
Author image of Jian-Huang Lai
School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
Guangdong Province Key Laboratory of Computational Science, Yat-sen University, Guangzhou, China
Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Yat-sen University, Guangzhou, China
Jian-Huang Lai (Senior Member, IEEE) received the M.Sc. degree in applied mathematics and the Ph.D. degree in mathematics from Sun Yat-sen University, Guangzhou, China, in 1989 and in 1999.
He joined Sun Yat-sen University as an Assistant Professor, in 1989, where he is currently a Professor with the School of Data and Computer Science. His current research interests include the areas of digital image processing, pattern r...Show More
Jian-Huang Lai (Senior Member, IEEE) received the M.Sc. degree in applied mathematics and the Ph.D. degree in mathematics from Sun Yat-sen University, Guangzhou, China, in 1989 and in 1999.
He joined Sun Yat-sen University as an Assistant Professor, in 1989, where he is currently a Professor with the School of Data and Computer Science. His current research interests include the areas of digital image processing, pattern r...View more
Author image of Philip S. Yu
Department of Computer Science, University of Illinois at Chicago, Chicago, IL, USA
Institute for Data Science, Tsinghua University, Beijing, China
Philip S. Yu (Life Fellow, IEEE) received the B.S. degree in electrical engineering from National Taiwan University, Taipei, Taiwan, in 1972, the M.S. and Ph.D. degrees in electrical engineering from Stanford University, Stanford, CA, USA, in 1976 and 1978, respectively, and the M.B.A. degree from New York University, New York, NY, USA.
He is currently a Distinguished Professor of computer science with the University of Il...Show More
Philip S. Yu (Life Fellow, IEEE) received the B.S. degree in electrical engineering from National Taiwan University, Taipei, Taiwan, in 1972, the M.S. and Ph.D. degrees in electrical engineering from Stanford University, Stanford, CA, USA, in 1976 and 1978, respectively, and the M.B.A. degree from New York University, New York, NY, USA.
He is currently a Distinguished Professor of computer science with the University of Il...View more

Author image of Chang-Dong Wang
School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
Guangdong Province Key Laboratory of Computational Science, Yat-sen University, Guangzhou, China
Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Yat-sen University, Guangzhou, China
Chang-Dong Wang (Member, IEEE) received the Ph.D. degree in computer science from Sun Yat-sen University, Guangzhou, China, in 2013.
He was a Visiting Student with the University of Illinois at Chicago, Chicago, IL, USA, from January 2012 to November 2012. He joined Sun Yat-sen University in 2013, where he is currently an Associate Professor with the School of Data and Computer Science. His current research interests include machine learning and data mining. He has published over 70 scientific articles in international journals and conferences such as the IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), the IEEE Transactions on Knowledge and Data Engineering (TKDE), the IEEE Transactions on Neural Networks and Learning Systems (TNNLS), the IEEE Transactions on Cybernetics (TCYB), ACM TKDD, the IEEE Transactions on Systems, Man, and Cybernetic: Systems (TSMC-Systems), the IEEE Transactions on Industrial Informatics (TII), the IEEE Transactions on Systems, Man, and Cybernetic: Systems (TSMC-C), ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), AAAI Conference on Artificial Intelligence (AAAI), International Joint Conference on Artificial Intelligence (IJCAI), Conference on Computer Vision and Pattern Recognition (CVPR), International Conference on Data Mining (ICDM), Conference on Information and Knowledge Management (CIKM), and SIAM International Conference on Data Mining (SDM).
Dr. Wang’s ICDM 2010 article received the Honorable Mention for Best Research Paper Awards and the 2012 Microsoft Research Fellowship Nomination Award. He was awarded 2015 Chinese Association for Artificial Intelligence (CAAI) Outstanding Dissertation. He is currently an Associate Editor for the Journal of Artificial Intelligence Research (JAIR).
Chang-Dong Wang (Member, IEEE) received the Ph.D. degree in computer science from Sun Yat-sen University, Guangzhou, China, in 2013.
He was a Visiting Student with the University of Illinois at Chicago, Chicago, IL, USA, from January 2012 to November 2012. He joined Sun Yat-sen University in 2013, where he is currently an Associate Professor with the School of Data and Computer Science. His current research interests include machine learning and data mining. He has published over 70 scientific articles in international journals and conferences such as the IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), the IEEE Transactions on Knowledge and Data Engineering (TKDE), the IEEE Transactions on Neural Networks and Learning Systems (TNNLS), the IEEE Transactions on Cybernetics (TCYB), ACM TKDD, the IEEE Transactions on Systems, Man, and Cybernetic: Systems (TSMC-Systems), the IEEE Transactions on Industrial Informatics (TII), the IEEE Transactions on Systems, Man, and Cybernetic: Systems (TSMC-C), ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), AAAI Conference on Artificial Intelligence (AAAI), International Joint Conference on Artificial Intelligence (IJCAI), Conference on Computer Vision and Pattern Recognition (CVPR), International Conference on Data Mining (ICDM), Conference on Information and Knowledge Management (CIKM), and SIAM International Conference on Data Mining (SDM).
Dr. Wang’s ICDM 2010 article received the Honorable Mention for Best Research Paper Awards and the 2012 Microsoft Research Fellowship Nomination Award. He was awarded 2015 Chinese Association for Artificial Intelligence (CAAI) Outstanding Dissertation. He is currently an Associate Editor for the Journal of Artificial Intelligence Research (JAIR).View more
Author image of Man-Sheng Chen
School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
Guangdong Province Key Laboratory of Computational Science, Yat-sen University, Guangzhou, China
Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Yat-sen University, Guangzhou, China
Man-Sheng Chen received the B.S. degree in computer science from South China Agricultural University, Guangzhou, China, in 2018. She is currently pursuing the master’s degree with Sun Yat-sen University, Guangzhou.
Her research interest is multiview clustering. She has published two articles in international conferences such as AAAI Conference on Artificial Intelligence (AAAI) and International Conference on Database Systems for Advanced Applications (DASFAA).
Man-Sheng Chen received the B.S. degree in computer science from South China Agricultural University, Guangzhou, China, in 2018. She is currently pursuing the master’s degree with Sun Yat-sen University, Guangzhou.
Her research interest is multiview clustering. She has published two articles in international conferences such as AAAI Conference on Artificial Intelligence (AAAI) and International Conference on Database Systems for Advanced Applications (DASFAA).View more
Author image of Ling Huang
College of Mathematics and Informatics, South China Agricultural University, Guangzhou, China
Ling Huang (Member, IEEE) received the Ph.D. degree in computer science from Sun Yat-sen University, Guangzhou, China, in 2020.
She joined South China Agricultural University, Guangzhou, as an Associate Professor in 2020. She has published over ten articles in international journals and conferences such as the IEEE Transactions on Knowledge and Data Engineering (TKDE), the IEEE Transactions on Neural Networks and Learning Systems (TNNLS), the IEEE Transactions on Cybernetics (TCYB), the IEEE Transactions on Industrial Informatics (TII), ACM TKDD, the IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), Pattern Recognition, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), AAAI Conference on Artificial Intelligence (AAAI), International Joint Conference on Artificial Intelligence (IJCAI), and International Conference on Data Mining (ICDM). Her research interest is data mining.
Ling Huang (Member, IEEE) received the Ph.D. degree in computer science from Sun Yat-sen University, Guangzhou, China, in 2020.
She joined South China Agricultural University, Guangzhou, as an Associate Professor in 2020. She has published over ten articles in international journals and conferences such as the IEEE Transactions on Knowledge and Data Engineering (TKDE), the IEEE Transactions on Neural Networks and Learning Systems (TNNLS), the IEEE Transactions on Cybernetics (TCYB), the IEEE Transactions on Industrial Informatics (TII), ACM TKDD, the IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), Pattern Recognition, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), AAAI Conference on Artificial Intelligence (AAAI), International Joint Conference on Artificial Intelligence (IJCAI), and International Conference on Data Mining (ICDM). Her research interest is data mining.View more
Author image of Jian-Huang Lai
School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
Guangdong Province Key Laboratory of Computational Science, Yat-sen University, Guangzhou, China
Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Yat-sen University, Guangzhou, China
Jian-Huang Lai (Senior Member, IEEE) received the M.Sc. degree in applied mathematics and the Ph.D. degree in mathematics from Sun Yat-sen University, Guangzhou, China, in 1989 and in 1999.
He joined Sun Yat-sen University as an Assistant Professor, in 1989, where he is currently a Professor with the School of Data and Computer Science. His current research interests include the areas of digital image processing, pattern recognition, multimedia communication, wavelet and its applications. He has published more than 200 scientific articles in the international journals and conferences on image processing and pattern recognition, such as the IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), the IEEE Transactions on Knowledge and Data Engineering (TKDE), the IEEE Transactions on Neural Networks and Learning Systems (TNNLS), the IEEE Transactions on Image Processing (TIP), the IEEE Transactions on Systems, Man, and Cybernetic: Systems (TSMC-B), Pattern Recognition, International Conference on Computer Vision (ICCV), Conference on Computer Vision and Pattern Recognition (CVPR), International Joint Conference on Artificial Intelligence (IJCAI), International Conference on Data Mining (ICDM), and SIAM International Conference on Data Mining (SDM).
Prof. Lai serves as a Standing Member of the Image and Graphics Association of China and the Standing Director of the Image and Graphics Association of Guangdong.
Jian-Huang Lai (Senior Member, IEEE) received the M.Sc. degree in applied mathematics and the Ph.D. degree in mathematics from Sun Yat-sen University, Guangzhou, China, in 1989 and in 1999.
He joined Sun Yat-sen University as an Assistant Professor, in 1989, where he is currently a Professor with the School of Data and Computer Science. His current research interests include the areas of digital image processing, pattern recognition, multimedia communication, wavelet and its applications. He has published more than 200 scientific articles in the international journals and conferences on image processing and pattern recognition, such as the IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), the IEEE Transactions on Knowledge and Data Engineering (TKDE), the IEEE Transactions on Neural Networks and Learning Systems (TNNLS), the IEEE Transactions on Image Processing (TIP), the IEEE Transactions on Systems, Man, and Cybernetic: Systems (TSMC-B), Pattern Recognition, International Conference on Computer Vision (ICCV), Conference on Computer Vision and Pattern Recognition (CVPR), International Joint Conference on Artificial Intelligence (IJCAI), International Conference on Data Mining (ICDM), and SIAM International Conference on Data Mining (SDM).
Prof. Lai serves as a Standing Member of the Image and Graphics Association of China and the Standing Director of the Image and Graphics Association of Guangdong.View more
Author image of Philip S. Yu
Department of Computer Science, University of Illinois at Chicago, Chicago, IL, USA
Institute for Data Science, Tsinghua University, Beijing, China
Philip S. Yu (Life Fellow, IEEE) received the B.S. degree in electrical engineering from National Taiwan University, Taipei, Taiwan, in 1972, the M.S. and Ph.D. degrees in electrical engineering from Stanford University, Stanford, CA, USA, in 1976 and 1978, respectively, and the M.B.A. degree from New York University, New York, NY, USA.
He is currently a Distinguished Professor of computer science with the University of Illinois at Chicago, Chicago, IL, USA, and also holds the Wexler Chair in information technology. Before joining UIC, he was the Manager of the Software Tools and Techniques Group, Watson Research Center, IBM. He has published more than 1 000 articles in refereed journals and conferences. He holds or has applied for more than 300 US patents. His research interest is on big data, including data mining, data stream, database, and privacy.
Dr. Yu is a fellow of ACM. He is on the Steering Committee of the ACM Conference on Information and Knowledge Management and was a member of the Steering Committee of the IEEE Data Engineering and the IEEE Conference on Data Mining. He was a recipient of the ACM SIGKDD 2016 Innovation Award for his influential research and scientific contributions on mining, fusion and anonymization of big data, the IEEE Computer Society’s 2013 Technical Achievement Award for pioneering and fundamentally innovative contributions to the scalable indexing, querying, searching, mining and anonymization of big data, and the Research Contributions Award from the IEEE International Conference on Data Mining (ICDM) in 2003 for his pioneering contributions to the field of data mining. He also received the ICDM 2013 10-year Highest-Impact Paper Award and the EDBT Test of Time Award in 2014. He had received several IBM honors including two IBM Outstanding Innovation Awards, the Outstanding Technical Achievement Award, the 2 Research Division Awards, and the 94th Plateau of Invention Achievement Awards. He was an IBM Master Inventor. He was the Editor-in-Chief of the ACM Transactions on Knowledge Discovery from Data from 2011 to 2017 and the IEEE Transactions on Knowledge and Data Engineering from 2001 to 2004.
Philip S. Yu (Life Fellow, IEEE) received the B.S. degree in electrical engineering from National Taiwan University, Taipei, Taiwan, in 1972, the M.S. and Ph.D. degrees in electrical engineering from Stanford University, Stanford, CA, USA, in 1976 and 1978, respectively, and the M.B.A. degree from New York University, New York, NY, USA.
He is currently a Distinguished Professor of computer science with the University of Illinois at Chicago, Chicago, IL, USA, and also holds the Wexler Chair in information technology. Before joining UIC, he was the Manager of the Software Tools and Techniques Group, Watson Research Center, IBM. He has published more than 1 000 articles in refereed journals and conferences. He holds or has applied for more than 300 US patents. His research interest is on big data, including data mining, data stream, database, and privacy.
Dr. Yu is a fellow of ACM. He is on the Steering Committee of the ACM Conference on Information and Knowledge Management and was a member of the Steering Committee of the IEEE Data Engineering and the IEEE Conference on Data Mining. He was a recipient of the ACM SIGKDD 2016 Innovation Award for his influential research and scientific contributions on mining, fusion and anonymization of big data, the IEEE Computer Society’s 2013 Technical Achievement Award for pioneering and fundamentally innovative contributions to the scalable indexing, querying, searching, mining and anonymization of big data, and the Research Contributions Award from the IEEE International Conference on Data Mining (ICDM) in 2003 for his pioneering contributions to the field of data mining. He also received the ICDM 2013 10-year Highest-Impact Paper Award and the EDBT Test of Time Award in 2014. He had received several IBM honors including two IBM Outstanding Innovation Awards, the Outstanding Technical Achievement Award, the 2 Research Division Awards, and the 94th Plateau of Invention Achievement Awards. He was an IBM Master Inventor. He was the Editor-in-Chief of the ACM Transactions on Knowledge Discovery from Data from 2011 to 2017 and the IEEE Transactions on Knowledge and Data Engineering from 2001 to 2004.View more

References

References is not available for this document.