Split CNN inference across end devices, MEC, and the cloud
Abstract:
Cloud computing is a critical component in the success of 5G and 6G networks, particularly given the computation-intensive nature of emerging applications. Despite all it...Show MoreMetadata
Abstract:
Cloud computing is a critical component in the success of 5G and 6G networks, particularly given the computation-intensive nature of emerging applications. Despite all it advantages, cloud computing faces limitations in meeting the strict latency and bandwidth requirements of applications such as eHealth and automotive systems. To overcome these limitations, edge computing has emerged as a novel paradigm that bring computation closer to the user. Moreover, intelligent tasks such as deep learning ones demand more memory and processing power than edge devices can handle. To address these challenges, methods like quantization, pruning, and distributed inference have been proposed. Similarly, this paper study a promising approach for running deep learning models at the edge: split neural networks (SNN). SNNs feature a neural network architecture with multiple early exit points, allowing the model to make confident decisions at earlier layers without processing the entire network. This not only reduces memory and computational demands but it also makes SNNs well-suited for edge computing applications. As the use of SNNs expands, ensuring their safety-particularly their robustness to perturbations-becomes crucial for deployment in safety-critical scenarios. This paper presents the first in-depth study on the robustness of split Edge Cloud neural networks. We review state-of-the-art robustness certification techniques and evaluate SNN robustness using the auto_LiRPA and Auto Attack libraries, comparing them to standard neural networks. Our results demonstrate that SNNs reduce average inference time by 75‘% and certify 4 to 10 times more images as robust, while improving overall robustness accuracy by 1% to 10%.
Split CNN inference across end devices, MEC, and the cloud
Published in: IEEE Access ( Volume: 12)

National School of Computer Science and Systems Analysis (ENSIAS), Mohammed V University in Rabat, Rabat, Morocco
Salmane Douch received the degree in electronics engineering from the Department of Electrical Engineering, Hassania School of Public Works, Casablanca, in 2020. He is currently pursuing the Ph.D. degree with the Smart System Labs, Mohammed V University in Rabat. He is also a Research Assistant in a research project funded by the USAID, Al Akhawayn University in Ifrane. His main research interests include cloud computing,...Show More
Salmane Douch received the degree in electronics engineering from the Department of Electrical Engineering, Hassania School of Public Works, Casablanca, in 2020. He is currently pursuing the Ph.D. degree with the Smart System Labs, Mohammed V University in Rabat. He is also a Research Assistant in a research project funded by the USAID, Al Akhawayn University in Ifrane. His main research interests include cloud computing,...View more

TSYS School of Computer Science, Columbus State University, Columbus, GA, USA
Mohamed Riduan Abid (Member, IEEE) received the Ph.D. degree in computer science from Auburn University, Auburn, IL, USA, in 2010. He is currently an Associate Professor at Columbus State University. He is a USA National Academy of Sciences (NAS) Arab-American Fellow. He has over 60 publications in renowned conferences and journals. His main research interests include cloud computing, data science pipelines, smart grids, ...Show More
Mohamed Riduan Abid (Member, IEEE) received the Ph.D. degree in computer science from Auburn University, Auburn, IL, USA, in 2010. He is currently an Associate Professor at Columbus State University. He is a USA National Academy of Sciences (NAS) Arab-American Fellow. He has over 60 publications in renowned conferences and journals. His main research interests include cloud computing, data science pipelines, smart grids, ...View more

Faculty of Sciences (FSR), Mohammed V University in Rabat, Rabat, Morocco
Khalid Zine-Dine received the Ph.D. degree from Mohammed V University in Rabat, Morocco, in 2000. He spent four years in Bank Information Systems as a Network and System Security Project Manager. He is currently a Full Professor at the Faculty of Sciences, Mohammed V University in Rabat. Recently, he has been interested in the field of microgrids and energy efficiency. He is involved in more than six Ph.D. theses and fund...Show More
Khalid Zine-Dine received the Ph.D. degree from Mohammed V University in Rabat, Morocco, in 2000. He spent four years in Bank Information Systems as a Network and System Security Project Manager. He is currently a Full Professor at the Faculty of Sciences, Mohammed V University in Rabat. Recently, he has been interested in the field of microgrids and energy efficiency. He is involved in more than six Ph.D. theses and fund...View more

National School of Computer Science and Systems Analysis (ENSIAS), Mohammed V University in Rabat, Rabat, Morocco
Driss Bouzidi is currently an Associate Professor in computer sciences at ENSIAS, Mohammed V University in Rabat, Morocco. He has made many contributions to several chapters in some international books related to e-learning. His research interests include distributed systems and security services. He is a Founding Member of two research associations APRIMT and e-NGN. He was the Vice-Chair of the international conference N...Show More
Driss Bouzidi is currently an Associate Professor in computer sciences at ENSIAS, Mohammed V University in Rabat, Morocco. He has made many contributions to several chapters in some international books related to e-learning. His research interests include distributed systems and security services. He is a Founding Member of two research associations APRIMT and e-NGN. He was the Vice-Chair of the international conference N...View more

College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
Driss Benhaddou (Senior Member, IEEE) received the first Ph.D. degree in optoelectronics from the University of Montpellier II, France, and the second Ph.D. degree in engineering and telecommunications from the University of Missouri-Kansas City. He is currently a Professor of electrical engineering at Alfaisal University, where he is actively involved in teaching and a broad range of research activities in the applicatio...Show More
Driss Benhaddou (Senior Member, IEEE) received the first Ph.D. degree in optoelectronics from the University of Montpellier II, France, and the second Ph.D. degree in engineering and telecommunications from the University of Missouri-Kansas City. He is currently a Professor of electrical engineering at Alfaisal University, where he is actively involved in teaching and a broad range of research activities in the applicatio...View more

National School of Computer Science and Systems Analysis (ENSIAS), Mohammed V University in Rabat, Rabat, Morocco
Salmane Douch received the degree in electronics engineering from the Department of Electrical Engineering, Hassania School of Public Works, Casablanca, in 2020. He is currently pursuing the Ph.D. degree with the Smart System Labs, Mohammed V University in Rabat. He is also a Research Assistant in a research project funded by the USAID, Al Akhawayn University in Ifrane. His main research interests include cloud computing, edge computing, edge intelligence, AI safety, and security at the edge.
Salmane Douch received the degree in electronics engineering from the Department of Electrical Engineering, Hassania School of Public Works, Casablanca, in 2020. He is currently pursuing the Ph.D. degree with the Smart System Labs, Mohammed V University in Rabat. He is also a Research Assistant in a research project funded by the USAID, Al Akhawayn University in Ifrane. His main research interests include cloud computing, edge computing, edge intelligence, AI safety, and security at the edge.View more

TSYS School of Computer Science, Columbus State University, Columbus, GA, USA
Mohamed Riduan Abid (Member, IEEE) received the Ph.D. degree in computer science from Auburn University, Auburn, IL, USA, in 2010. He is currently an Associate Professor at Columbus State University. He is a USA National Academy of Sciences (NAS) Arab-American Fellow. He has over 60 publications in renowned conferences and journals. His main research interests include cloud computing, data science pipelines, smart grids, and high-performance computing (HPC). He is a member of ACM. He is fond of coaching and programming. He won, for six consecutive years (2014, 2015, 2016, 2017, 2018, and 2019), the first prize as a Coach, at the National ACM Moroccan Collegiate Programming Contest (MCPC) contest organized by the Moroccan-ACM (Association for Computer Machinery), and qualified twice to the ACM ICPC (International Collegiate Programming Contest) World Finals: 2015 in Marrakech, and 2018 in Beijing. He received the Fulbright Student Scholarship. In 2017, he received a Fulbright Research Scholarship to the University of Houston, Houston, TX, USA. In 2018, he received a NAS Scholarship to join Purdue University, West Lafayette, IN, USA, for a Summer research stay.
Mohamed Riduan Abid (Member, IEEE) received the Ph.D. degree in computer science from Auburn University, Auburn, IL, USA, in 2010. He is currently an Associate Professor at Columbus State University. He is a USA National Academy of Sciences (NAS) Arab-American Fellow. He has over 60 publications in renowned conferences and journals. His main research interests include cloud computing, data science pipelines, smart grids, and high-performance computing (HPC). He is a member of ACM. He is fond of coaching and programming. He won, for six consecutive years (2014, 2015, 2016, 2017, 2018, and 2019), the first prize as a Coach, at the National ACM Moroccan Collegiate Programming Contest (MCPC) contest organized by the Moroccan-ACM (Association for Computer Machinery), and qualified twice to the ACM ICPC (International Collegiate Programming Contest) World Finals: 2015 in Marrakech, and 2018 in Beijing. He received the Fulbright Student Scholarship. In 2017, he received a Fulbright Research Scholarship to the University of Houston, Houston, TX, USA. In 2018, he received a NAS Scholarship to join Purdue University, West Lafayette, IN, USA, for a Summer research stay.View more

Faculty of Sciences (FSR), Mohammed V University in Rabat, Rabat, Morocco
Khalid Zine-Dine received the Ph.D. degree from Mohammed V University in Rabat, Morocco, in 2000. He spent four years in Bank Information Systems as a Network and System Security Project Manager. He is currently a Full Professor at the Faculty of Sciences, Mohammed V University in Rabat. Recently, he has been interested in the field of microgrids and energy efficiency. He is involved in more than six Ph.D. theses and funded projects. His research interests include wireless ad hoc and sensor networks, mobility, cloud computing, and system and network architectures and protocols. He was a co-organizer and co-chair of conferences.
Khalid Zine-Dine received the Ph.D. degree from Mohammed V University in Rabat, Morocco, in 2000. He spent four years in Bank Information Systems as a Network and System Security Project Manager. He is currently a Full Professor at the Faculty of Sciences, Mohammed V University in Rabat. Recently, he has been interested in the field of microgrids and energy efficiency. He is involved in more than six Ph.D. theses and funded projects. His research interests include wireless ad hoc and sensor networks, mobility, cloud computing, and system and network architectures and protocols. He was a co-organizer and co-chair of conferences.View more

National School of Computer Science and Systems Analysis (ENSIAS), Mohammed V University in Rabat, Rabat, Morocco
Driss Bouzidi is currently an Associate Professor in computer sciences at ENSIAS, Mohammed V University in Rabat, Morocco. He has made many contributions to several chapters in some international books related to e-learning. His research interests include distributed systems and security services. He is a Founding Member of two research associations APRIMT and e-NGN. He was the Vice-Chair of the international conference NGNS’09, the TCP Chair of NGNS10, NGNS12, and ICEER13, and the Chair of JDSIRT’2017.
Driss Bouzidi is currently an Associate Professor in computer sciences at ENSIAS, Mohammed V University in Rabat, Morocco. He has made many contributions to several chapters in some international books related to e-learning. His research interests include distributed systems and security services. He is a Founding Member of two research associations APRIMT and e-NGN. He was the Vice-Chair of the international conference NGNS’09, the TCP Chair of NGNS10, NGNS12, and ICEER13, and the Chair of JDSIRT’2017.View more

College of Engineering, Alfaisal University, Riyadh, Saudi Arabia
Driss Benhaddou (Senior Member, IEEE) received the first Ph.D. degree in optoelectronics from the University of Montpellier II, France, and the second Ph.D. degree in engineering and telecommunications from the University of Missouri-Kansas City. He is currently a Professor of electrical engineering at Alfaisal University, where he is actively involved in teaching and a broad range of research activities in the application of computation and communication technologies in smart grids, smart cities applications, transportation, and smart agriculture. He also holds a courtesy position at the University of Houston. He has published more than 130 peer-reviewed conference and journal publications. His research interests include applied AI/ML, simulation tool modeling, software development, networking, switching system designs, and routing protocol development.
Driss Benhaddou (Senior Member, IEEE) received the first Ph.D. degree in optoelectronics from the University of Montpellier II, France, and the second Ph.D. degree in engineering and telecommunications from the University of Missouri-Kansas City. He is currently a Professor of electrical engineering at Alfaisal University, where he is actively involved in teaching and a broad range of research activities in the application of computation and communication technologies in smart grids, smart cities applications, transportation, and smart agriculture. He also holds a courtesy position at the University of Houston. He has published more than 130 peer-reviewed conference and journal publications. His research interests include applied AI/ML, simulation tool modeling, software development, networking, switching system designs, and routing protocol development.View more