Information Integration in Social Science Research: Advances with LLMs in the NAIP Project

NAIP is a collaborative project between social scientists and computer scientists to facilitate and promote datadriven research on nonprofit organizations. A major thrust of NAIP is the treatment of socioeconomic datasets such as IRS from 990 and census data for statistical analysis on nonprofits. This paper describes recent advances and experiences using Large Language Models (LLMs) to facilitate data cleaning, modeling, and automated SQL query generation on NAIP datasets. With non-trivial prompt engineering, LLMs become capable of generating useful SQL queries, but significant efforts are still needed for evaluation and validation.