Generative Artificial Intelligence on Edge Devices: Models, Hardware, and Systems: A tutorial

Generative artificial intelligence (GenAI) refers to the use of neural networks to produce new output data, which could be in the form of text, image, audio, video, or other modalities. During training, these models learn the underlying distributions of the data such that, during inference, they can generate new output data in response to an input prompt (typically a text prompt). In recent years, we have witnessed a staggeringly rapid progression in capability and sophistication of these generative models, following a major boom in investment in AI research during the 2020s. This article provides a brief tutorial on GenAI for edge devices, as a summary of the tutorial of the same name given at the International Solid State Circuits Conference (ISSCC) this year.