Understanding the Performance of Large Language Model to Generate SQL Queries

Recent developments in Artificial Intelligence (AI) have shifted the software development paradigm. Past studies demonstrated how effective AI can generate code for programming purposes. However, to our knowledge, no prior study has been done to evaluate the effectiveness of SQL queries generated by AI. We utilized nine AI assistants to generate SQL queries. Our results reveal that most AI assistants generate inaccurate SQL queries, and based on the results, we provide possible implications for SQL developers.