Vision-Language Models for 3D Scene Understanding: Applications and Developments

This article focuses on the applications and advances of Visual Language Modeling (VLM) in 3D scene understanding. The article details several mainstream visual language models and analyzes the application of visual language models to three different downstream tasks including: 3D Question and Answering, 3D Visual Grounding, and 3D Semantic Segmentation. In addition, the article systematically reviews commonly used datasets and evaluation metrics in the field and analyzes the current challenges in depth. Finally, the article provides an outlook on the future development direction, which provides useful references and insights for subsequent research.