Enhancing Educational Websites With AI Chatbots: Design Considerations for Safety

Generative AI and Large Language Models provide an immense opportunity to add value to educational organizations and websites. However, a software engineering challenge exists to integrate GenAI while factoring in the requirements of educational sites. We describe a pipeline for testing generative AI chatbots for an academic site [1]. We describe our requirements, which we believe will be represented in other educational sites, and our approach to test case generation, prompt engineering, and response assessments across various Large Language Models. We also present case study results and pipeline code in an open-source repository [14].