Addressing a New Paradigm Shift in Data Science: An Empirical Study on Novel Project Characteristics for Foundation Model Projects

We present novel requirements that arise from real-world projects incorporating foundation models based on 29 case studies from the natural language understanding domain, assessing existing data science methodologies, identifying shortcomings, and providing guidance on adapting projects to address new challenges.