Large Language Model-Driven Immersive Agent

Recent research in the field of Large Language Models (LLMs) has given a new direction to the capabilities of AI agents for solving complex problems. This paper attempts to explore one such use case to investigate LLMs-based AI agents’ role in immersive technology, specifically focusing on GPT-4’s vision capabilities in Augmented Reality (AR). The paper utilizes Smart App Agent Framework for recommending products. This recommendation system assists users to make context-aware decisions during their online shopping experience.