Loading [MathJax]/extensions/MathMenu.js
A NoC-Based Spatial DNN Inference Accelerator With Memory-Friendly Dataflow | IEEE Journals & Magazine | IEEE Xplore

A NoC-Based Spatial DNN Inference Accelerator With Memory-Friendly Dataflow


Abstract:

This article addresses the challenges of excessive storage overhead and the absence of sparsity-aware design in Network-on-Chip (NoC)-based spatial deep neural network ac...Show More

Abstract:

This article addresses the challenges of excessive storage overhead and the absence of sparsity-aware design in Network-on-Chip (NoC)-based spatial deep neural network accelerators. The authors present a prototype chip that outperforms existing accelerators in both energy and area efficiency, demonstrated on TSMC 28-nm process technology. —Mahdi Nikdast, Colorado State University, USA —Miquel Moreto, Barcelona Supercomputing Center, Spain —Masoumeh (Azin) Ebrahimi, KTH Royal Institute of Technology, Sweden —Sujay Deb, IIIT Delhi, India
Published in: IEEE Design & Test ( Volume: 40, Issue: 6, December 2023)
Page(s): 39 - 50
Date of Publication: 30 August 2023

ISSN Information:

Funding Agency:

School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Lingxiao Zhu is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip (NoC), neural network accelerators, and stochastic computing.
Lingxiao Zhu is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip (NoC), neural network accelerators, and stochastic computing.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Wenjie Fan is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip (NoC) and neural network accelerators.
Wenjie Fan is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip (NoC) and neural network accelerators.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Chenyang Dai is pursuing an ME at the School of Integrated Circuits (IC), Nanjing University, Nanjing 210023, China. His current research interests include approximate computing and neural network accelerators.
Chenyang Dai is pursuing an ME at the School of Integrated Circuits (IC), Nanjing University, Nanjing 210023, China. His current research interests include approximate computing and neural network accelerators.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Shize Zhou is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip architecture designs, neural network accelerators, and approximate communication.
Shize Zhou is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip architecture designs, neural network accelerators, and approximate communication.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Yongqi Xue is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. Her current research interests include network-on-chip mapping optimization and artificial intelligence (AI) for chip architecture designs.
Yongqi Xue is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. Her current research interests include network-on-chip mapping optimization and artificial intelligence (AI) for chip architecture designs.View more
Department of Electrical Engineering, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Kista, Sweden
Zhonghai Lu is a full professor in electronic systems design at the School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, 16440 Kista, Sweden. His research interests include SoC/network-on-chip (NoC), embedded systems, computer architecture, and artificial intelligence (AI). Lu has a PhD from KTH Royal Institute of Technology. He is a Senior Member of IEEE.
Zhonghai Lu is a full professor in electronic systems design at the School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, 16440 Kista, Sweden. His research interests include SoC/network-on-chip (NoC), embedded systems, computer architecture, and artificial intelligence (AI). Lu has a PhD from KTH Royal Institute of Technology. He is a Senior Member of IEEE.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Li Li is a professor at Nanjing University, Nanjing 210023, China. Her current research interests include very large scale integration (VLSI) design for digital signal processing systems reconfigurable computing and multiprocessor SoC (MPSoC) architecture design methodology. Li has a PhD from the Hefei University of Technology, Hefei, China. She is a Member of IEEE.
Li Li is a professor at Nanjing University, Nanjing 210023, China. Her current research interests include very large scale integration (VLSI) design for digital signal processing systems reconfigurable computing and multiprocessor SoC (MPSoC) architecture design methodology. Li has a PhD from the Hefei University of Technology, Hefei, China. She is a Member of IEEE.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Yuxiang Fu is an assistant professor at the School of Integrated Circuits (ICs), Nanjing University, Nanjing 210023, China. His current research interests include artificial intelligence (AI) for chip architecture designs, network-on-chip algorithms/architectures, low-power digital systems, and 3D IC designs. Fu has a PhD in electronic science and technology from Nanjing University. He is a Member of IEEE.
Yuxiang Fu is an assistant professor at the School of Integrated Circuits (ICs), Nanjing University, Nanjing 210023, China. His current research interests include artificial intelligence (AI) for chip architecture designs, network-on-chip algorithms/architectures, low-power digital systems, and 3D IC designs. Fu has a PhD in electronic science and technology from Nanjing University. He is a Member of IEEE.View more

School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Lingxiao Zhu is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip (NoC), neural network accelerators, and stochastic computing.
Lingxiao Zhu is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip (NoC), neural network accelerators, and stochastic computing.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Wenjie Fan is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip (NoC) and neural network accelerators.
Wenjie Fan is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip (NoC) and neural network accelerators.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Chenyang Dai is pursuing an ME at the School of Integrated Circuits (IC), Nanjing University, Nanjing 210023, China. His current research interests include approximate computing and neural network accelerators.
Chenyang Dai is pursuing an ME at the School of Integrated Circuits (IC), Nanjing University, Nanjing 210023, China. His current research interests include approximate computing and neural network accelerators.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Shize Zhou is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip architecture designs, neural network accelerators, and approximate communication.
Shize Zhou is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. His current research interests include network-on-chip architecture designs, neural network accelerators, and approximate communication.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Yongqi Xue is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. Her current research interests include network-on-chip mapping optimization and artificial intelligence (AI) for chip architecture designs.
Yongqi Xue is pursuing an ME at the School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. Her current research interests include network-on-chip mapping optimization and artificial intelligence (AI) for chip architecture designs.View more
Department of Electrical Engineering, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Kista, Sweden
Zhonghai Lu is a full professor in electronic systems design at the School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, 16440 Kista, Sweden. His research interests include SoC/network-on-chip (NoC), embedded systems, computer architecture, and artificial intelligence (AI). Lu has a PhD from KTH Royal Institute of Technology. He is a Senior Member of IEEE.
Zhonghai Lu is a full professor in electronic systems design at the School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, 16440 Kista, Sweden. His research interests include SoC/network-on-chip (NoC), embedded systems, computer architecture, and artificial intelligence (AI). Lu has a PhD from KTH Royal Institute of Technology. He is a Senior Member of IEEE.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Li Li is a professor at Nanjing University, Nanjing 210023, China. Her current research interests include very large scale integration (VLSI) design for digital signal processing systems reconfigurable computing and multiprocessor SoC (MPSoC) architecture design methodology. Li has a PhD from the Hefei University of Technology, Hefei, China. She is a Member of IEEE.
Li Li is a professor at Nanjing University, Nanjing 210023, China. Her current research interests include very large scale integration (VLSI) design for digital signal processing systems reconfigurable computing and multiprocessor SoC (MPSoC) architecture design methodology. Li has a PhD from the Hefei University of Technology, Hefei, China. She is a Member of IEEE.View more
School of Integrated Circuits and the School of Electronic Science and Engineering, Nanjing University, Nanjing, China
Yuxiang Fu is an assistant professor at the School of Integrated Circuits (ICs), Nanjing University, Nanjing 210023, China. His current research interests include artificial intelligence (AI) for chip architecture designs, network-on-chip algorithms/architectures, low-power digital systems, and 3D IC designs. Fu has a PhD in electronic science and technology from Nanjing University. He is a Member of IEEE.
Yuxiang Fu is an assistant professor at the School of Integrated Circuits (ICs), Nanjing University, Nanjing 210023, China. His current research interests include artificial intelligence (AI) for chip architecture designs, network-on-chip algorithms/architectures, low-power digital systems, and 3D IC designs. Fu has a PhD in electronic science and technology from Nanjing University. He is a Member of IEEE.View more
Contact IEEE to Subscribe

References

References is not available for this document.