Traffic Engineering in Partially Deployed Segment Routing Over IPv6 Network With Deep Reinforcement Learning | IEEE Journals & Magazine | IEEE Xplore

Traffic Engineering in Partially Deployed Segment Routing Over IPv6 Network With Deep Reinforcement Learning


Abstract:

Segment Routing (SR) is a source routing paradigm which is widely used in Traffic Engineering (TE). By using SR, a node steers a packet through an ordered list of instruc...Show More

Abstract:

Segment Routing (SR) is a source routing paradigm which is widely used in Traffic Engineering (TE). By using SR, a node steers a packet through an ordered list of instructions called segments. By some extensions of interior gateway protocol, SR can be applied to IP/MPLS or IPv6 network without signal protocol. SR over IPv6 (SRv6) is attracting wide attention because of its interoperation ability with IPv6. However, upgrading the existing IPv6 network directly to a full SRv6 one can be difficult, because large-scale equipment replacement or software upgrade may cause economic and technical problems. TE in partially deployed SR network is becoming a hot research topic. In this paper, we propose the TE algorithm Weight Adjustment-SRTE (WA-SRTE) in partially deployed SRv6 network, in which SRv6 capable nodes are dispersedly deployed. Our objective is to minimize the network's maximum link utilization. WA-SRTE converts the TE problem into a Deep Reinforcement Learning problem and optimizes the OSPF weight, SRv6 node deployment and traffic paths simultaneously. Besides, traffic variation is also considered and we use a representative Traffic Matrix (TM) to epitomize the traffic characteristics over a period of time. Experiments demonstrate that with 20% to 40% of the SRv6 nodes deployed, we can achieve TE performance as good as in a full SR network for the experiment topologies. The results with WA remarkably outperform the results without it. Our algorithm also gets near-optimal results with changing traffic.
Published in: IEEE/ACM Transactions on Networking ( Volume: 28, Issue: 4, August 2020)
Page(s): 1573 - 1586
Date of Publication: 01 May 2020

ISSN Information:

Funding Agency:

Author image of Ying Tian
Department of Computer Science and Technology, Tsinghua University, Beijing, China
Ying Tian received the B.E. degree in computer science from the Beijing University of Posts and Telecommunications, China, in 2018. She is currently pursuing the Ph.D. degree with the Department of Computer Science and Technology, Tsinghua University. Her research interests include traffic engineering, routing optimization, segment routing, and software-defined networking.
Ying Tian received the B.E. degree in computer science from the Beijing University of Posts and Telecommunications, China, in 2018. She is currently pursuing the Ph.D. degree with the Department of Computer Science and Technology, Tsinghua University. Her research interests include traffic engineering, routing optimization, segment routing, and software-defined networking.View more
Author image of Zhiliang Wang
Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China
Institute for Network Sciences and Cyberspace, Tsinghua University, Beijing, China
Zhiliang Wang (Member, IEEE) received the B.E., M.E., and Ph.D. degrees in computer science from Tsinghua University, China, in 2001, 2003, and 2006, respectively. He is currently an Associate Professor with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University. His research interests include formal methods and protocol testing, n...Show More
Zhiliang Wang (Member, IEEE) received the B.E., M.E., and Ph.D. degrees in computer science from Tsinghua University, China, in 2001, 2003, and 2006, respectively. He is currently an Associate Professor with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University. His research interests include formal methods and protocol testing, n...View more
Author image of Xia Yin
Department of Computer Science and Technology, Tsinghua University, Beijing, China
Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China
Xia Yin (Senior Member, IEEE) received the B.E., M.E., and Ph.D. degrees in computer science from Tsinghua University in 1995, 1997, and 2000, respectively. She is currently a Full Professor with the Department of Computer Science and Technology and Beijing National Research Center for Information Science and Technology, Tsinghua University. Her research interests include future Internet architecture, formal method, proto...Show More
Xia Yin (Senior Member, IEEE) received the B.E., M.E., and Ph.D. degrees in computer science from Tsinghua University in 1995, 1997, and 2000, respectively. She is currently a Full Professor with the Department of Computer Science and Technology and Beijing National Research Center for Information Science and Technology, Tsinghua University. Her research interests include future Internet architecture, formal method, proto...View more
Author image of Xingang Shi
Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China
Institute for Network Sciences and Cyberspace, Tsinghua University, Beijing, China
Xingang Shi (Member, IEEE) received the B.S. degree from Tsinghua University and the Ph.D. degree from The Chinese University of Hong Kong. He is currently working with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University. He is also a Researcher with the Beijing National Research Center for Information Science and Technology. Hi...Show More
Xingang Shi (Member, IEEE) received the B.S. degree from Tsinghua University and the Ph.D. degree from The Chinese University of Hong Kong. He is currently working with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University. He is also a Researcher with the Beijing National Research Center for Information Science and Technology. Hi...View more
Author image of Yingya Guo
College of Mathematics and Computer Science, Fuzhou University, Fuzhou, China
Yingya Guo received the B.S. degree in computer science from Xiamen University in 2013 and the Ph.D. degree in computer science and technology from Tsinghua University, China, in 2019. She is currently an Assistant Professor with the College of Mathematics and Computer Science, Fuzhou University, Fuzhou, China. Her research interests include traffic engineering, routing optimization, and software defined networking.
Yingya Guo received the B.S. degree in computer science from Xiamen University in 2013 and the Ph.D. degree in computer science and technology from Tsinghua University, China, in 2019. She is currently an Assistant Professor with the College of Mathematics and Computer Science, Fuzhou University, Fuzhou, China. Her research interests include traffic engineering, routing optimization, and software defined networking.View more
Author image of Haijun Geng
School of Software Engineering, Shanxi University, Shanxi, China
Haijun Geng received the B.E. degree from Yantai University in 2008, the M.E. degree from Capital Normal University in 2011, and the Ph.D. degree Tsinghua University in 2015. He is currently working with the School of Software Engineering, Shanxi University. His research interests include future Internet architecture and large scale Internet routing.
Haijun Geng received the B.E. degree from Yantai University in 2008, the M.E. degree from Capital Normal University in 2011, and the Ph.D. degree Tsinghua University in 2015. He is currently working with the School of Software Engineering, Shanxi University. His research interests include future Internet architecture and large scale Internet routing.View more
Author image of Jiahai Yang
Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China
Institute for Network Sciences and Cyberspace, Tsinghua University, Beijing, China
Jiahai Yang (Senior Member, IEEE) received the B.Sc. degree from Beijing Technology and Business University, and the M.Sc. and Ph.D. degrees from Tsinghua University, China, all in computer science. He is currently a Professor with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China. His research interests includ...Show More
Jiahai Yang (Senior Member, IEEE) received the B.Sc. degree from Beijing Technology and Business University, and the M.Sc. and Ph.D. degrees from Tsinghua University, China, all in computer science. He is currently a Professor with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China. His research interests includ...View more

Author image of Ying Tian
Department of Computer Science and Technology, Tsinghua University, Beijing, China
Ying Tian received the B.E. degree in computer science from the Beijing University of Posts and Telecommunications, China, in 2018. She is currently pursuing the Ph.D. degree with the Department of Computer Science and Technology, Tsinghua University. Her research interests include traffic engineering, routing optimization, segment routing, and software-defined networking.
Ying Tian received the B.E. degree in computer science from the Beijing University of Posts and Telecommunications, China, in 2018. She is currently pursuing the Ph.D. degree with the Department of Computer Science and Technology, Tsinghua University. Her research interests include traffic engineering, routing optimization, segment routing, and software-defined networking.View more
Author image of Zhiliang Wang
Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China
Institute for Network Sciences and Cyberspace, Tsinghua University, Beijing, China
Zhiliang Wang (Member, IEEE) received the B.E., M.E., and Ph.D. degrees in computer science from Tsinghua University, China, in 2001, 2003, and 2006, respectively. He is currently an Associate Professor with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University. His research interests include formal methods and protocol testing, next-generation Internet, and network measurement.
Zhiliang Wang (Member, IEEE) received the B.E., M.E., and Ph.D. degrees in computer science from Tsinghua University, China, in 2001, 2003, and 2006, respectively. He is currently an Associate Professor with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University. His research interests include formal methods and protocol testing, next-generation Internet, and network measurement.View more
Author image of Xia Yin
Department of Computer Science and Technology, Tsinghua University, Beijing, China
Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China
Xia Yin (Senior Member, IEEE) received the B.E., M.E., and Ph.D. degrees in computer science from Tsinghua University in 1995, 1997, and 2000, respectively. She is currently a Full Professor with the Department of Computer Science and Technology and Beijing National Research Center for Information Science and Technology, Tsinghua University. Her research interests include future Internet architecture, formal method, protocol testing, and large-scale Internet routing.
Xia Yin (Senior Member, IEEE) received the B.E., M.E., and Ph.D. degrees in computer science from Tsinghua University in 1995, 1997, and 2000, respectively. She is currently a Full Professor with the Department of Computer Science and Technology and Beijing National Research Center for Information Science and Technology, Tsinghua University. Her research interests include future Internet architecture, formal method, protocol testing, and large-scale Internet routing.View more
Author image of Xingang Shi
Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China
Institute for Network Sciences and Cyberspace, Tsinghua University, Beijing, China
Xingang Shi (Member, IEEE) received the B.S. degree from Tsinghua University and the Ph.D. degree from The Chinese University of Hong Kong. He is currently working with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University. He is also a Researcher with the Beijing National Research Center for Information Science and Technology. His research interests include network measurement and routing protocols.
Xingang Shi (Member, IEEE) received the B.S. degree from Tsinghua University and the Ph.D. degree from The Chinese University of Hong Kong. He is currently working with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University. He is also a Researcher with the Beijing National Research Center for Information Science and Technology. His research interests include network measurement and routing protocols.View more
Author image of Yingya Guo
College of Mathematics and Computer Science, Fuzhou University, Fuzhou, China
Yingya Guo received the B.S. degree in computer science from Xiamen University in 2013 and the Ph.D. degree in computer science and technology from Tsinghua University, China, in 2019. She is currently an Assistant Professor with the College of Mathematics and Computer Science, Fuzhou University, Fuzhou, China. Her research interests include traffic engineering, routing optimization, and software defined networking.
Yingya Guo received the B.S. degree in computer science from Xiamen University in 2013 and the Ph.D. degree in computer science and technology from Tsinghua University, China, in 2019. She is currently an Assistant Professor with the College of Mathematics and Computer Science, Fuzhou University, Fuzhou, China. Her research interests include traffic engineering, routing optimization, and software defined networking.View more
Author image of Haijun Geng
School of Software Engineering, Shanxi University, Shanxi, China
Haijun Geng received the B.E. degree from Yantai University in 2008, the M.E. degree from Capital Normal University in 2011, and the Ph.D. degree Tsinghua University in 2015. He is currently working with the School of Software Engineering, Shanxi University. His research interests include future Internet architecture and large scale Internet routing.
Haijun Geng received the B.E. degree from Yantai University in 2008, the M.E. degree from Capital Normal University in 2011, and the Ph.D. degree Tsinghua University in 2015. He is currently working with the School of Software Engineering, Shanxi University. His research interests include future Internet architecture and large scale Internet routing.View more
Author image of Jiahai Yang
Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China
Institute for Network Sciences and Cyberspace, Tsinghua University, Beijing, China
Jiahai Yang (Senior Member, IEEE) received the B.Sc. degree from Beijing Technology and Business University, and the M.Sc. and Ph.D. degrees from Tsinghua University, China, all in computer science. He is currently a Professor with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China. His research interests include network management, network measurement, network security, Internet routing, cloud computing, and big data applications.
Jiahai Yang (Senior Member, IEEE) received the B.Sc. degree from Beijing Technology and Business University, and the M.Sc. and Ph.D. degrees from Tsinghua University, China, all in computer science. He is currently a Professor with the Institute for Network Sciences and Cyberspace and Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China. His research interests include network management, network measurement, network security, Internet routing, cloud computing, and big data applications.View more
Contact IEEE to Subscribe

References

References is not available for this document.