Abstract:
Effective learning of asymmetric and local features in images and other data observed on multi-dimensional grids is a challenging objective critical for a wide range of i...Show MoreMetadata
Abstract:
Effective learning of asymmetric and local features in images and other data observed on multi-dimensional grids is a challenging objective critical for a wide range of image processing applications involving biomedical and natural images. It requires methods that are sensitive to local details while fast enough to handle massive numbers of images of ever increasing sizes. We introduce a probabilistic model-based framework that achieves these objectives by incorporating adaptivity into discrete wavelet transforms (DWT) through Bayesian hierarchical modeling, thereby allowing wavelet bases to adapt to the geometric structure of the data while maintaining the high computational scalability of wavelet methods—linear in the sample size (e.g., the resolution of an image). We derive a recursive representation of the Bayesian posterior model which leads to an exact message passing algorithm to complete learning and inference. While our framework is applicable to a range of problems including multi-dimensional signal processing, compression, and structural learning, we illustrate its work and evaluate its performance in the context of image reconstruction using real images from the ImageNet database, two widely used benchmark datasets, and a dataset from retinal optical coherence tomography and compare its performance to state-of-the-art methods based on basis transforms and deep learning.
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence ( Volume: 44, Issue: 11, 01 November 2022)
Funding Agency:

Department of Statistics, Rice University, Houston, TX, USA
Meng Li received the BS degree in statistics from Sun Yat-sen University, Guangzhou, China, in 2010, and the MS and PhD degrees in statistics from North Carolina State University, Raleigh, North Carolina, in 2012 and 2015, respectively. He was a visiting assistant professor with the Department of Statistical Science, Duke University from 2015 to 2017. He joined the Department of Statistics, Rice University as the Noah Har...Show More
Meng Li received the BS degree in statistics from Sun Yat-sen University, Guangzhou, China, in 2010, and the MS and PhD degrees in statistics from North Carolina State University, Raleigh, North Carolina, in 2012 and 2015, respectively. He was a visiting assistant professor with the Department of Statistical Science, Duke University from 2015 to 2017. He joined the Department of Statistics, Rice University as the Noah Har...View more

Department of Statistical Science, Duke University, Durham, NC, USA
Li Ma received the BA degrees in math, statistics, and economics and the MS degree from the University of Chicago, Chicago, Illinois, in 2006, and the PhD degree in statistics from Stanford University, Stanford, California, in 2011. He was an assistant professor with the Department of Statistical Science, Duke University from 2011 to 2018, and is currently an associate professor there. His research interests include Bayes...Show More
Li Ma received the BA degrees in math, statistics, and economics and the MS degree from the University of Chicago, Chicago, Illinois, in 2006, and the PhD degree in statistics from Stanford University, Stanford, California, in 2011. He was an assistant professor with the Department of Statistical Science, Duke University from 2011 to 2018, and is currently an associate professor there. His research interests include Bayes...View more

Department of Statistics, Rice University, Houston, TX, USA
Meng Li received the BS degree in statistics from Sun Yat-sen University, Guangzhou, China, in 2010, and the MS and PhD degrees in statistics from North Carolina State University, Raleigh, North Carolina, in 2012 and 2015, respectively. He was a visiting assistant professor with the Department of Statistical Science, Duke University from 2015 to 2017. He joined the Department of Statistics, Rice University as the Noah Harding assistant professor in 2017. His research focuses on structured high-dimensional and nonparametric inference on complex data with theoretical guarantees and scalable implementation. He received the Ralph E. Powe junior faculty enhancement awards in 2018, Empower Partnerships with Industry (PEPI) Award by NSF South Big Data Hub in 2016, and Student Paper Award in Section on Bayesian Statistical Science by JSM in 2014.
Meng Li received the BS degree in statistics from Sun Yat-sen University, Guangzhou, China, in 2010, and the MS and PhD degrees in statistics from North Carolina State University, Raleigh, North Carolina, in 2012 and 2015, respectively. He was a visiting assistant professor with the Department of Statistical Science, Duke University from 2015 to 2017. He joined the Department of Statistics, Rice University as the Noah Harding assistant professor in 2017. His research focuses on structured high-dimensional and nonparametric inference on complex data with theoretical guarantees and scalable implementation. He received the Ralph E. Powe junior faculty enhancement awards in 2018, Empower Partnerships with Industry (PEPI) Award by NSF South Big Data Hub in 2016, and Student Paper Award in Section on Bayesian Statistical Science by JSM in 2014.View more

Department of Statistical Science, Duke University, Durham, NC, USA
Li Ma received the BA degrees in math, statistics, and economics and the MS degree from the University of Chicago, Chicago, Illinois, in 2006, and the PhD degree in statistics from Stanford University, Stanford, California, in 2011. He was an assistant professor with the Department of Statistical Science, Duke University from 2011 to 2018, and is currently an associate professor there. His research interests include Bayesian modeling, multi-scale inference, model choice and hypothesis testing, scalable statistical computing, and biological applications. He received a Google Faculty Research Award in Machine Learning in 2016 and an NSF CAREER Award in Statistics in 2018.
Li Ma received the BA degrees in math, statistics, and economics and the MS degree from the University of Chicago, Chicago, Illinois, in 2006, and the PhD degree in statistics from Stanford University, Stanford, California, in 2011. He was an assistant professor with the Department of Statistical Science, Duke University from 2011 to 2018, and is currently an associate professor there. His research interests include Bayesian modeling, multi-scale inference, model choice and hypothesis testing, scalable statistical computing, and biological applications. He received a Google Faculty Research Award in Machine Learning in 2016 and an NSF CAREER Award in Statistics in 2018.View more