Overview and Trend of Large-scale Model Deployment Mode

Currently, large-scale model have transitioned from a period of algorithm research to a period of industry application. This paper presents a comprehensive review of large-scale model deployment modes. It provides an overview of the various deployment mode, their advantages and disadvantages. We delve into the critical factors that must be taken into account when selecting a deployment mode for large-scale model. We present the various deployment modes available for large-scale models, including centralized deployment, distributed deployment, and edge computing deployment. We particularly focus on edge computing deployment mode and analyze evolving trends in large-scale model deployment. We specially conducted an analysis on converged infrastructure and edge AI of large-scale model. Furthermore, we provide insights into the main challenges and future research directions in this field.