SmartMLVs: LLM-enabled Multiple Linked Views Generation for Interactive Visualization

Automating the generation of multiple linked view visualization is imperative for improving data analysis efficiency. Large Language Models (LLMs) offer substantial potential for enabling this automation, yet they encounter notable challenges in understanding complex queries and producing relevant interactive visualizations. To tackle these challenges, we introduce SmartMLVs, a system designed to harness LLMs for automatic interactive multiple linked views generation with human guidance. First, we analyze the challenges LLMs may encounter when designing visualizations in place of experts. To address these challenges, we gather the essential domain knowledge required for visual analysis process and propose a framework consisting of decomposition, visualization and linking. The decomposition process applies a human-AI interaction method to clarify user requirements. For each decomposed question, the generation process handles chart type selection, data processing and visualization generation. Finally, the linking process adds interactions for views and provides users with data insights. For better human-AI collaboration, we design a system for data exploration. Our system applies the entire framework, supporting users’ interactive exploration with multiple linked views, and can iteratively generate linked views based on user feedback. We examine the effectiveness of our method through usage scenarios and evaluations.