DomainVoyager: Embracing The Unknown Domain by Prompting for Automatic Augmentation

For medical image analysis, domain generalization (DG) faces significant challenges due to variances in data across medical imaging devices. Addressing this, we introduce Prompt Guided Domain Aligning Augmentation (PGDAA), a novel approach that harnesses Large Language Models (LLMs) to iteratively refine data augmentation sequences in DG for medical segmentations. Specifically, by harnessing the LLM’s advanced capabilities in interpreting and responding to specific prompts, PGDAA iteratively voyages the parameter searching space for data augmentation, identifying optimal augmentation sequences. In each searching round, the LLM leverages provided prior data augmentation methods, their parameters, and corresponding evaluation results to acquire a sufficient performance memory bank, thereby proposing more effective augmentation sequences to significantly narrowing inter-domain gaps. Notably, this integration of LLMs in DG represents a pioneering application in the field, which adds minor training parameters and can be easily combined with other DG benchmarks for further improvements. Comprehensive experiments reveal our method outperforms the baseline by 4.47% and 5.08% on Fundus and Prostate datasets, achieving 90.10% and 89.28% accuracy, respectively.