Integration of Voice Assistant with ChatGPT and DALL-E

This paper discusses the integration of voice assistant with ChatGPT and Dall-E. JANY is an app that allows users to interact with the app using voice and it gets the subsequent response in speech as well as in text format. In the present-day context, the significance of voice interactions cannot be overstated, as they play a vital role in providing a seamless experience. Our approach involves converting speech to text, where the resulting text acts as an input for ChatGPT and DALL-E, followed by transforming the responses from text to speech. This is done taking into consideration people who can't read or write, the blind, old people, etc. The use of voice assistants integrated with AI like ChatGPT and DALL-E has tremendous potential as it provides an easy user experience and can also be accessed by people who have difficulty using traditional text-based interactions. Further, the paper also discusses the challenges encountered while integrating voice assistants with ChatGPT and DALL-E and how we overcame these challenges. The paper covers the system architecture, API calls, and libraries that were utilized, along with code snippets where required.