Abstract:
In the first part of this study, a convex-constrained penalized formulation was studied for a class of constant modulus (CM) problems. In particular, the error bound tech...Show MoreMetadata
Abstract:
In the first part of this study, a convex-constrained penalized formulation was studied for a class of constant modulus (CM) problems. In particular, the error bound techniques were shown to play a vital role in providing exact penalization results. In this second part of the study, we continue our error bound analysis for the cases of partial permutation matrices, size-constrained assignment matrices and non-negative semi-orthogonal matrices. We develop new error bounds and penalized formulations for these three cases, and the new formulations possess good structures for building computationally efficient algorithms. Moreover, we provide numerical results to demonstrate our framework in a variety of applications such as the densest k-subgraph problem, graph matching, size-constrained clustering, non-negative orthogonal matrix factorization and sparse fair principal component analysis.
Published in: IEEE Transactions on Signal Processing ( Volume: 72)
Funding Agency:

Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
Junbin Liu (Graduate Student Member, IEEE) received the B.S. degree from the South China University of Technology, Guangzhou, China, in 2017, and the M.S. degree from the University of Chinese Academy of Sciences, in 2020. He is currently working toward the Ph.D. degree with the Department of Electronic Engineering, The Chinese University of Hong Kong, under the supervision of Professor Wing-Kin Ma. His research interests...Show More
Junbin Liu (Graduate Student Member, IEEE) received the B.S. degree from the South China University of Technology, Guangzhou, China, in 2017, and the M.S. degree from the University of Chinese Academy of Sciences, in 2020. He is currently working toward the Ph.D. degree with the Department of Electronic Engineering, The Chinese University of Hong Kong, under the supervision of Professor Wing-Kin Ma. His research interests...View more

Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
Ya Liu received the B.S. degree from the University of Electronic Science and Technology of China, Chengdu, China, in 2018. She is currently working toward the Ph.D. degree with the Department of Electronic Engineering, The Chinese University of Hong Kong, under the supervision of Professor Wing-Kin Ma. Her research interests include matrix factorization, signal processing, and optimization, along with their diverse appli...Show More
Ya Liu received the B.S. degree from the University of Electronic Science and Technology of China, Chengdu, China, in 2018. She is currently working toward the Ph.D. degree with the Department of Electronic Engineering, The Chinese University of Hong Kong, under the supervision of Professor Wing-Kin Ma. Her research interests include matrix factorization, signal processing, and optimization, along with their diverse appli...View more

Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
Wing-Kin Ma (Fellow, IEEE) is currently a Professor with the Department of Electronic Engineering, The Chinese University of Hong Kong (CUHK), Hong Kong. His research interests include signal processing, optimization and communications, with recent focus on: i) optimization and statistical aspects with structured matrix factorization, with application to remote sensing and data science; and ii) coarsely quantized MIMO tra...Show More
Wing-Kin Ma (Fellow, IEEE) is currently a Professor with the Department of Electronic Engineering, The Chinese University of Hong Kong (CUHK), Hong Kong. His research interests include signal processing, optimization and communications, with recent focus on: i) optimization and statistical aspects with structured matrix factorization, with application to remote sensing and data science; and ii) coarsely quantized MIMO tra...View more

School of Information Science and Engineering, Shandong University, Qingdao, China
Mingjie Shao (Member, IEEE) received the B.S. degree from Xidian University, Xi’an, China, in 2015, and the Ph.D. degree from The Chinese University of Hong Kong (CUHK), in 2020. He was a Postdoctoral Fellow with the Department of Electronic Engineering, CUHK from 2020 to 2023. He is currently a Research Professor (Qilu Young Scholar) with the School of Information Science and Engineering, Shandong University, Qingdao, Ch...Show More
Mingjie Shao (Member, IEEE) received the B.S. degree from Xidian University, Xi’an, China, in 2015, and the Ph.D. degree from The Chinese University of Hong Kong (CUHK), in 2020. He was a Postdoctoral Fellow with the Department of Electronic Engineering, CUHK from 2020 to 2023. He is currently a Research Professor (Qilu Young Scholar) with the School of Information Science and Engineering, Shandong University, Qingdao, Ch...View more

Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, Hong Kong SAR, China
Anthony Man-Cho So (Fellow, IEEE) received the B.S.E. degree in computer science from Princeton University, Princeton, NJ, USA, with minors in applied and computational mathematics, engineering and management systems, and German language and culture, and the M.Sc. degree in computer science and the Ph.D. degree in computer science with a Ph.D. minor in mathematics from Stanford University, Stanford, CA, USA. He is current...Show More
Anthony Man-Cho So (Fellow, IEEE) received the B.S.E. degree in computer science from Princeton University, Princeton, NJ, USA, with minors in applied and computational mathematics, engineering and management systems, and German language and culture, and the M.Sc. degree in computer science and the Ph.D. degree in computer science with a Ph.D. minor in mathematics from Stanford University, Stanford, CA, USA. He is current...View more

Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
Junbin Liu (Graduate Student Member, IEEE) received the B.S. degree from the South China University of Technology, Guangzhou, China, in 2017, and the M.S. degree from the University of Chinese Academy of Sciences, in 2020. He is currently working toward the Ph.D. degree with the Department of Electronic Engineering, The Chinese University of Hong Kong, under the supervision of Professor Wing-Kin Ma. His research interests include statistical signal processing methods, optimization theories, and their wide-ranging applications.
Junbin Liu (Graduate Student Member, IEEE) received the B.S. degree from the South China University of Technology, Guangzhou, China, in 2017, and the M.S. degree from the University of Chinese Academy of Sciences, in 2020. He is currently working toward the Ph.D. degree with the Department of Electronic Engineering, The Chinese University of Hong Kong, under the supervision of Professor Wing-Kin Ma. His research interests include statistical signal processing methods, optimization theories, and their wide-ranging applications.View more

Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
Ya Liu received the B.S. degree from the University of Electronic Science and Technology of China, Chengdu, China, in 2018. She is currently working toward the Ph.D. degree with the Department of Electronic Engineering, The Chinese University of Hong Kong, under the supervision of Professor Wing-Kin Ma. Her research interests include matrix factorization, signal processing, and optimization, along with their diverse applications.
Ya Liu received the B.S. degree from the University of Electronic Science and Technology of China, Chengdu, China, in 2018. She is currently working toward the Ph.D. degree with the Department of Electronic Engineering, The Chinese University of Hong Kong, under the supervision of Professor Wing-Kin Ma. Her research interests include matrix factorization, signal processing, and optimization, along with their diverse applications.View more

Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
Wing-Kin Ma (Fellow, IEEE) is currently a Professor with the Department of Electronic Engineering, The Chinese University of Hong Kong (CUHK), Hong Kong. His research interests include signal processing, optimization and communications, with recent focus on: i) optimization and statistical aspects with structured matrix factorization, with application to remote sensing and data science; and ii) coarsely quantized MIMO transceiver designs. He has rich experience in editorial service, such as an Associate Editor, and then later, a Senior Area Editor, and then from 2021 to 2023, the Editor-in-Chief of the IEEE Transactions on Signal Processing, and many others. He was a Tutorial Speaker in EUSIPCO 2011 and ICASSP 2014, and was an IEEE Signal Processing Society (SPS) Distinguished Lecturer in from 2018 to 2019. He was the recipient of the Research Excellence Award 2013–2014 by CUHK, the 2015 IEEE Signal Processing Magazine Best Paper Award, the 2016 IEEE Signal Processing Letters Best Paper Award, and the 2018 IEEE SPS Best Paper Award. He served as a Member of the Signal Processing for Communications and Networking Technical Committee (SPCOM-TC) in 2015–2020, a member of Signal Processing Theory and Methods Technical Committee (SPTM-TC) in 2012–2017, the SPS Regional Director-at-Large for Region 10 in 2020–2021, and a Technical Program Co-Chair of ICASSP 2023. He co-founded and co-organized One World Signal Processing in 2020, a virtual seminar series for signal processing.
Wing-Kin Ma (Fellow, IEEE) is currently a Professor with the Department of Electronic Engineering, The Chinese University of Hong Kong (CUHK), Hong Kong. His research interests include signal processing, optimization and communications, with recent focus on: i) optimization and statistical aspects with structured matrix factorization, with application to remote sensing and data science; and ii) coarsely quantized MIMO transceiver designs. He has rich experience in editorial service, such as an Associate Editor, and then later, a Senior Area Editor, and then from 2021 to 2023, the Editor-in-Chief of the IEEE Transactions on Signal Processing, and many others. He was a Tutorial Speaker in EUSIPCO 2011 and ICASSP 2014, and was an IEEE Signal Processing Society (SPS) Distinguished Lecturer in from 2018 to 2019. He was the recipient of the Research Excellence Award 2013–2014 by CUHK, the 2015 IEEE Signal Processing Magazine Best Paper Award, the 2016 IEEE Signal Processing Letters Best Paper Award, and the 2018 IEEE SPS Best Paper Award. He served as a Member of the Signal Processing for Communications and Networking Technical Committee (SPCOM-TC) in 2015–2020, a member of Signal Processing Theory and Methods Technical Committee (SPTM-TC) in 2012–2017, the SPS Regional Director-at-Large for Region 10 in 2020–2021, and a Technical Program Co-Chair of ICASSP 2023. He co-founded and co-organized One World Signal Processing in 2020, a virtual seminar series for signal processing.View more

School of Information Science and Engineering, Shandong University, Qingdao, China
Mingjie Shao (Member, IEEE) received the B.S. degree from Xidian University, Xi’an, China, in 2015, and the Ph.D. degree from The Chinese University of Hong Kong (CUHK), in 2020. He was a Postdoctoral Fellow with the Department of Electronic Engineering, CUHK from 2020 to 2023. He is currently a Research Professor (Qilu Young Scholar) with the School of Information Science and Engineering, Shandong University, Qingdao, China. His research interests include convex and non-convex optimization, statistical signal processing and machine learning for wireless communication. He was the recipient of the Hong Kong Ph.D. Fellowship Scheme from 2015. He was listed in the Student Best Paper Finalists in ICASSP 2017.
Mingjie Shao (Member, IEEE) received the B.S. degree from Xidian University, Xi’an, China, in 2015, and the Ph.D. degree from The Chinese University of Hong Kong (CUHK), in 2020. He was a Postdoctoral Fellow with the Department of Electronic Engineering, CUHK from 2020 to 2023. He is currently a Research Professor (Qilu Young Scholar) with the School of Information Science and Engineering, Shandong University, Qingdao, China. His research interests include convex and non-convex optimization, statistical signal processing and machine learning for wireless communication. He was the recipient of the Hong Kong Ph.D. Fellowship Scheme from 2015. He was listed in the Student Best Paper Finalists in ICASSP 2017.View more

Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, Hong Kong SAR, China
Anthony Man-Cho So (Fellow, IEEE) received the B.S.E. degree in computer science from Princeton University, Princeton, NJ, USA, with minors in applied and computational mathematics, engineering and management systems, and German language and culture, and the M.Sc. degree in computer science and the Ph.D. degree in computer science with a Ph.D. minor in mathematics from Stanford University, Stanford, CA, USA. He is currently the Dean of the Graduate School, Deputy Master of Morningside College, and a Professor with the Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong (CUHK), Hong Kong SAR, China. His research interests include optimization theory and its applications in various areas of science and engineering, including computational geometry, machine learning, signal processing, and statistics. He is a fellow of the Hong Kong Institution of Engineers. He is the recipient of a number of research and teaching awards, including the 2024 INFORMS Computing Society Prize, the SIAM Review SIGEST Award in 2024, the 2022 University Grants Committee Teaching Award, the 2018 IEEE Signal Processing Society Best Paper Award, the 2015 IEEE Signal Processing Society Signal Processing Magazine Best Paper Award, the 2014 IEEE Communications Society Asia-Pacific Outstanding Paper Award, the 2013 CUHK Vice-Chancellor's Exemplary Teaching Award, and the 2010 INFORMS Optimization Society Optimization Prize for Young Researchers. He currently serves on the Editorial Boards of Journal of Global Optimization, Mathematics of Operations Research, Mathematical Programming, Open Journal of Mathematical Optimization, Optimization Methods and Software, and SIAM Journal on Optimization. He was also the Lead Guest Editor of the Special Issue on Non-Convex Optimization for Signal Processing and Machine Learning of the IEEE Signal Processing Magazine and a Guest Editor of the Special Issue on Advanced Optimization Theory and Algorithms for Next Generation Wireless Communication Networks of the IEEE Journal on Selected Areas in Communications.
Anthony Man-Cho So (Fellow, IEEE) received the B.S.E. degree in computer science from Princeton University, Princeton, NJ, USA, with minors in applied and computational mathematics, engineering and management systems, and German language and culture, and the M.Sc. degree in computer science and the Ph.D. degree in computer science with a Ph.D. minor in mathematics from Stanford University, Stanford, CA, USA. He is currently the Dean of the Graduate School, Deputy Master of Morningside College, and a Professor with the Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong (CUHK), Hong Kong SAR, China. His research interests include optimization theory and its applications in various areas of science and engineering, including computational geometry, machine learning, signal processing, and statistics. He is a fellow of the Hong Kong Institution of Engineers. He is the recipient of a number of research and teaching awards, including the 2024 INFORMS Computing Society Prize, the SIAM Review SIGEST Award in 2024, the 2022 University Grants Committee Teaching Award, the 2018 IEEE Signal Processing Society Best Paper Award, the 2015 IEEE Signal Processing Society Signal Processing Magazine Best Paper Award, the 2014 IEEE Communications Society Asia-Pacific Outstanding Paper Award, the 2013 CUHK Vice-Chancellor's Exemplary Teaching Award, and the 2010 INFORMS Optimization Society Optimization Prize for Young Researchers. He currently serves on the Editorial Boards of Journal of Global Optimization, Mathematics of Operations Research, Mathematical Programming, Open Journal of Mathematical Optimization, Optimization Methods and Software, and SIAM Journal on Optimization. He was also the Lead Guest Editor of the Special Issue on Non-Convex Optimization for Signal Processing and Machine Learning of the IEEE Signal Processing Magazine and a Guest Editor of the Special Issue on Advanced Optimization Theory and Algorithms for Next Generation Wireless Communication Networks of the IEEE Journal on Selected Areas in Communications.View more