Abstract:
Universal access to and provisioning of multimedia content is now a reality. It is easy to generate, distribute, share, and consume any multimedia content, anywhere, anyt...Show MoreMetadata
Abstract:
Universal access to and provisioning of multimedia content is now a reality. It is easy to generate, distribute, share, and consume any multimedia content, anywhere, anytime, or any device. Open media standards took a crucial role toward enabling all these use cases leading to a plethora of applications and services that have now become a commodity in our daily life. Interestingly, most of these services adopt a streaming paradigm, are typically deployed over the open, unmanaged Internet, and account for most of today’s Internet traffic. Currently, the global video traffic is greater than 60% of all Internet traffic [1], and it is expected that this share will grow to more than 80% in the near future [2]. In addition, Nielsen’s law of Internet bandwidth states that the users’ bandwidth grows by 50% per year, which roughly fits data from 1983 to 2019 [3]. Thus, the users’ bandwidth can be expected to reach approximately 1 Gb/s by 2022. At the same time, network applications will grow and utilize the bandwidth provided, just like programs and their data expand to fill the memory available in a computer system. Most of the available bandwidth today is consumed by video applications, and the amount of data is further increasing due to already established and emerging applications, e.g., ultrahigh definition, high dynamic range, or virtual, augmented, mixed realities, or immersive media applications in general.
Published in: Proceedings of the IEEE ( Volume: 109, Issue: 9, September 2021)
Christian Timmerer (Senior Member, IEEE) received the M.Sc. (Dipl.Ing.) and Ph.D. (Dr.techn.) degrees (for research on the adaptation of scalable multimedia content in streaming and constraint environments) from Alpen-Adria-Universität (AAU), Klagenfurt, Austria, in January 2003 and June 2006, respectively.
He is currently an Associate Professor with the Institute of Information Technology (ITEC) and the Director of the Ch...Show More
Christian Timmerer (Senior Member, IEEE) received the M.Sc. (Dipl.Ing.) and Ph.D. (Dr.techn.) degrees (for research on the adaptation of scalable multimedia content in streaming and constraint environments) from Alpen-Adria-Universität (AAU), Klagenfurt, Austria, in January 2003 and June 2006, respectively.
He is currently an Associate Professor with the Institute of Information Technology (ITEC) and the Director of the Ch...View more
Mathias Wien (Member, IEEE) received the Diploma and Dr.Ing. degrees from Rheinisch-Westfälische Technische Hochschule Aachen (RWTH Aachen University), Aachen, Germany, in 1997 and 2004, respectively. In 2018, he achieved the status of the Habilitation, which makes him an independent scientist in the field of visual media communication.
He was with the Institut für Nachrichtentechnik, RWTH Aachen University (Head: Prof. Je...Show More
Mathias Wien (Member, IEEE) received the Diploma and Dr.Ing. degrees from Rheinisch-Westfälische Technische Hochschule Aachen (RWTH Aachen University), Aachen, Germany, in 1997 and 2004, respectively. In 2018, he achieved the status of the Habilitation, which makes him an independent scientist in the field of visual media communication.
He was with the Institut für Nachrichtentechnik, RWTH Aachen University (Head: Prof. Je...View more
Lu Yu (Senior Member, IEEE) received the B.Eng. degree (honors) in radio engineering and the Ph.D. degree in communication and electronic systems from Zhejiang University, Hangzhou, China, in 1991 and 1996, respectively.
After that, she joined Zhejiang University as a Faculty Member. She is currently a Professor with the College of Information Science and Electronic Engineering and the Director of the Institute of Informat...Show More
Lu Yu (Senior Member, IEEE) received the B.Eng. degree (honors) in radio engineering and the Ph.D. degree in communication and electronic systems from Zhejiang University, Hangzhou, China, in 1991 and 1996, respectively.
After that, she joined Zhejiang University as a Faculty Member. She is currently a Professor with the College of Information Science and Electronic Engineering and the Director of the Institute of Informat...View more
Amy Reibman (Fellow, IEEE) is currently a Professor of electrical and computer engineering with Purdue University, West Lafayette, IN, USA. She pursued 23 years of industrial research at AT&T Labs—Research, Atlanta, GA, USA, where she was a Distinguished Member of Technical Staff and a Lead Inventive Scientist. She has published over 40 journal articles and 120 conference papers. She holds more than 60 U.S. patents. Her r...Show More
Amy Reibman (Fellow, IEEE) is currently a Professor of electrical and computer engineering with Purdue University, West Lafayette, IN, USA. She pursued 23 years of industrial research at AT&T Labs—Research, Atlanta, GA, USA, where she was a Distinguished Member of Technical Staff and a Lead Inventive Scientist. She has published over 40 journal articles and 120 conference papers. She holds more than 60 U.S. patents. Her r...View more
Contents Christian Timmerer (Senior Member, IEEE) received the M.Sc. (Dipl.Ing.) and Ph.D. (Dr.techn.) degrees (for research on the adaptation of scalable multimedia content in streaming and constraint environments) from Alpen-Adria-Universität (AAU), Klagenfurt, Austria, in January 2003 and June 2006, respectively.
He is currently an Associate Professor with the Institute of Information Technology (ITEC) and the Director of the Christian Doppler Laboratory ATHENA, AAU. In 2013, he cofounded Bitmovin, Klagenfurt, to provide professional services around MPEG-DASH where he holds the position of the Chief Innovation Officer (CIO)—Head of Research and Standardization. His research interests include immersive multimedia communication, streaming, adaptation, quality of experience, and sensory experience.
Dr. Timmerer is a member of the Association for Computing Machinery (ACM), the IEEE Computer Society, the IEEE Communications Society, and ACM Special Interest Group on Multimedia (SIGMM). He was the General Chair of Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS) 2008, International Conference on Quality of Multimedia Experience (QoMEX) 2013, ACM Multimedia Systems Conference (MMSys) 2016, and ACM Packet Video (PV) Workshop 2018 and has participated in several EC-funded projects, notably DANAE, ENTHRONE, P2P-Next, ALICANTE, SocialSensor, COST IC1003 QUALINET, and ICoSOLE. He also participated in ISO/MPEG work for several years, notably in the area of MPEG-21, MPEG-M, MPEG-V, and MPEG-DASH, where he also served as a Standard Editor. He was a Guest Editor of three special issues of IEEE Journal on Selected Areas in Communications (JSAC). He has served as an Associate Editor for IEEE Transactions on Multimedia. Further information is available at http://blog.timmerer.com.
Christian Timmerer (Senior Member, IEEE) received the M.Sc. (Dipl.Ing.) and Ph.D. (Dr.techn.) degrees (for research on the adaptation of scalable multimedia content in streaming and constraint environments) from Alpen-Adria-Universität (AAU), Klagenfurt, Austria, in January 2003 and June 2006, respectively.
He is currently an Associate Professor with the Institute of Information Technology (ITEC) and the Director of the Christian Doppler Laboratory ATHENA, AAU. In 2013, he cofounded Bitmovin, Klagenfurt, to provide professional services around MPEG-DASH where he holds the position of the Chief Innovation Officer (CIO)—Head of Research and Standardization. His research interests include immersive multimedia communication, streaming, adaptation, quality of experience, and sensory experience.
Dr. Timmerer is a member of the Association for Computing Machinery (ACM), the IEEE Computer Society, the IEEE Communications Society, and ACM Special Interest Group on Multimedia (SIGMM). He was the General Chair of Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS) 2008, International Conference on Quality of Multimedia Experience (QoMEX) 2013, ACM Multimedia Systems Conference (MMSys) 2016, and ACM Packet Video (PV) Workshop 2018 and has participated in several EC-funded projects, notably DANAE, ENTHRONE, P2P-Next, ALICANTE, SocialSensor, COST IC1003 QUALINET, and ICoSOLE. He also participated in ISO/MPEG work for several years, notably in the area of MPEG-21, MPEG-M, MPEG-V, and MPEG-DASH, where he also served as a Standard Editor. He was a Guest Editor of three special issues of IEEE Journal on Selected Areas in Communications (JSAC). He has served as an Associate Editor for IEEE Transactions on Multimedia. Further information is available at http://blog.timmerer.com.View more
Mathias Wien (Member, IEEE) received the Diploma and Dr.Ing. degrees from Rheinisch-Westfälische Technische Hochschule Aachen (RWTH Aachen University), Aachen, Germany, in 1997 and 2004, respectively. In 2018, he achieved the status of the Habilitation, which makes him an independent scientist in the field of visual media communication.
He was with the Institut für Nachrichtentechnik, RWTH Aachen University (Head: Prof. Jens-Rainer Ohm), as a Researcher from 1997 to 2006 and a Senior Researcher and the Head of Administration from 2006 to 2018. Since July 2018, he has been with the Lehrstuhl für Bildverarbeitung, RWTH Aachen University (Head: Prof. Dorit Merhof), as a Senior Researcher, a Leader of the Visual Media Communication Group, and the Head of Administration. He also serves as the Conventor of ISO/IEC JTC1 AG5 “Visual Quality Assessment.” He has been an Active Contributor to VVC, HEVC, and H.264/AVC. He has participated and contributed to ITU-T VCEG, ISO/IEC MPEG, the Joint Video Team (JVT), the Joint Collaborative Team on Video Coding (JCT-VC), and the Joint Video Experts Team (JVET) of VCEG and ISO/IEC MPEG. He has served as a Coeditor of the Scalability Amendment to H.264/AVC (SVC). In the aforementioned standardization bodies, he has co-chaired and coordinated several ad hoc groups and tool and core experiments. He has published more than 60 scientific articles and conference papers in the area of video coding and has coauthored several patents in this area. He has further authored and coauthored more than 200 standardization documents. He has published the Springer textbook High Efficiency Video Coding: Coding Tools and Specification that fully covers Version 1 of HEVC. His research interests include image and video processing, immersive, space–frequency adaptive and scalable video compression, and robust video transmission.
Dr. Wien is a member of the IEEE Signal Processing Society and the IEEE Circuits and Systems Society. He is also a member of IEEE Circuits and Systems Society Technical Committee Visual Signal Processing and Communications (CASS TC VSPC). He has co-organized and co-chaired special sessions at IEEE International Conference on Visual Communications and Image Processing (VCIP) and Picture Coding Symposium (PCS). He has co-organized and co-chaired the Grand Challenge on Video Compression Technology at IEEE International Conference on Image Processing (ICIP) 2017. He also serves as an Associate Editor for IEEE Transactions on Circuits and Systems for Video Technology and Signal Processing: Image Communication.
Mathias Wien (Member, IEEE) received the Diploma and Dr.Ing. degrees from Rheinisch-Westfälische Technische Hochschule Aachen (RWTH Aachen University), Aachen, Germany, in 1997 and 2004, respectively. In 2018, he achieved the status of the Habilitation, which makes him an independent scientist in the field of visual media communication.
He was with the Institut für Nachrichtentechnik, RWTH Aachen University (Head: Prof. Jens-Rainer Ohm), as a Researcher from 1997 to 2006 and a Senior Researcher and the Head of Administration from 2006 to 2018. Since July 2018, he has been with the Lehrstuhl für Bildverarbeitung, RWTH Aachen University (Head: Prof. Dorit Merhof), as a Senior Researcher, a Leader of the Visual Media Communication Group, and the Head of Administration. He also serves as the Conventor of ISO/IEC JTC1 AG5 “Visual Quality Assessment.” He has been an Active Contributor to VVC, HEVC, and H.264/AVC. He has participated and contributed to ITU-T VCEG, ISO/IEC MPEG, the Joint Video Team (JVT), the Joint Collaborative Team on Video Coding (JCT-VC), and the Joint Video Experts Team (JVET) of VCEG and ISO/IEC MPEG. He has served as a Coeditor of the Scalability Amendment to H.264/AVC (SVC). In the aforementioned standardization bodies, he has co-chaired and coordinated several ad hoc groups and tool and core experiments. He has published more than 60 scientific articles and conference papers in the area of video coding and has coauthored several patents in this area. He has further authored and coauthored more than 200 standardization documents. He has published the Springer textbook High Efficiency Video Coding: Coding Tools and Specification that fully covers Version 1 of HEVC. His research interests include image and video processing, immersive, space–frequency adaptive and scalable video compression, and robust video transmission.
Dr. Wien is a member of the IEEE Signal Processing Society and the IEEE Circuits and Systems Society. He is also a member of IEEE Circuits and Systems Society Technical Committee Visual Signal Processing and Communications (CASS TC VSPC). He has co-organized and co-chaired special sessions at IEEE International Conference on Visual Communications and Image Processing (VCIP) and Picture Coding Symposium (PCS). He has co-organized and co-chaired the Grand Challenge on Video Compression Technology at IEEE International Conference on Image Processing (ICIP) 2017. He also serves as an Associate Editor for IEEE Transactions on Circuits and Systems for Video Technology and Signal Processing: Image Communication.View more
Lu Yu (Senior Member, IEEE) received the B.Eng. degree (honors) in radio engineering and the Ph.D. degree in communication and electronic systems from Zhejiang University, Hangzhou, China, in 1991 and 1996, respectively.
After that, she joined Zhejiang University as a Faculty Member. She is currently a Professor with the College of Information Science and Electronic Engineering and the Director of the Institute of Information and CommunicationNetworks, Zhejiang University. She contributed more than 100 adopted technical proposals to video coding standards, including those defined by AVS, IEEE, ISO/IEC MPEG, and ITU-T SG16. Her research area includes visual perception and perceptual quality assessment, visual signal representation and coding, multimedia processing, and related architecture design, in which she published more than 160 articles and invented more than 80 granted patents.
Prof. Yu acted as the Video Sub-Group Co-Chair and the Chair of the Audio and Video Coding Standardization Working Group (AVS) for 16 years. She has been appointed as the Video Sub-Group Chair of MPEG in January 2018. She is also the Convenor of ISO/IEC JTC 1/SC 29/WG 4, MPEG Video Coding.
Lu Yu (Senior Member, IEEE) received the B.Eng. degree (honors) in radio engineering and the Ph.D. degree in communication and electronic systems from Zhejiang University, Hangzhou, China, in 1991 and 1996, respectively.
After that, she joined Zhejiang University as a Faculty Member. She is currently a Professor with the College of Information Science and Electronic Engineering and the Director of the Institute of Information and CommunicationNetworks, Zhejiang University. She contributed more than 100 adopted technical proposals to video coding standards, including those defined by AVS, IEEE, ISO/IEC MPEG, and ITU-T SG16. Her research area includes visual perception and perceptual quality assessment, visual signal representation and coding, multimedia processing, and related architecture design, in which she published more than 160 articles and invented more than 80 granted patents.
Prof. Yu acted as the Video Sub-Group Co-Chair and the Chair of the Audio and Video Coding Standardization Working Group (AVS) for 16 years. She has been appointed as the Video Sub-Group Chair of MPEG in January 2018. She is also the Convenor of ISO/IEC JTC 1/SC 29/WG 4, MPEG Video Coding.View more
Amy Reibman (Fellow, IEEE) is currently a Professor of electrical and computer engineering with Purdue University, West Lafayette, IN, USA. She pursued 23 years of industrial research at AT&T Labs—Research, Atlanta, GA, USA, where she was a Distinguished Member of Technical Staff and a Lead Inventive Scientist. She has published over 40 journal articles and 120 conference papers. She holds more than 60 U.S. patents. Her research interests are in video analytics, video stabilization, and image and video quality assessment. She has also done pioneering work on video transmission over packet networks. Her current research focuses on video analytics for real-world applications where inputs may have substantial-quality impairments.
Dr. Reibman was elected as an IEEE Fellow in 2005 for her contributions to video transport over networks. She was a member of the IEEE Awards Committee from 2010 to 2012. In 1998, she won the IEEE Communications Society Leonard G. Abraham Prize Paper Award. She was the Chair of the IEEE Fellow Committee from 2016 to 2017 and a Judge on the IEEE Fellow Committee from 2012 to 2015 and the IEEE Fellow Strategic Planning Committee from 2013 to 2019. She was the Technical Co-Chair of the IEEE International Conference on Image Processing in 2002. She was a Distinguished Lecturer for the IEEE Signal Processing Society from 2008 to 2009.
Amy Reibman (Fellow, IEEE) is currently a Professor of electrical and computer engineering with Purdue University, West Lafayette, IN, USA. She pursued 23 years of industrial research at AT&T Labs—Research, Atlanta, GA, USA, where she was a Distinguished Member of Technical Staff and a Lead Inventive Scientist. She has published over 40 journal articles and 120 conference papers. She holds more than 60 U.S. patents. Her research interests are in video analytics, video stabilization, and image and video quality assessment. She has also done pioneering work on video transmission over packet networks. Her current research focuses on video analytics for real-world applications where inputs may have substantial-quality impairments.
Dr. Reibman was elected as an IEEE Fellow in 2005 for her contributions to video transport over networks. She was a member of the IEEE Awards Committee from 2010 to 2012. In 1998, she won the IEEE Communications Society Leonard G. Abraham Prize Paper Award. She was the Chair of the IEEE Fellow Committee from 2016 to 2017 and a Judge on the IEEE Fellow Committee from 2012 to 2015 and the IEEE Fellow Strategic Planning Committee from 2013 to 2019. She was the Technical Co-Chair of the IEEE International Conference on Image Processing in 2002. She was a Distinguished Lecturer for the IEEE Signal Processing Society from 2008 to 2009.View more