Integrating Multimodal AI Models for Enhanced Oral Cancer Detection and Diagnosis

Oral cancer is a major global health issue marked by high morbidity and mortality rates, primarily due to late-stage diagnosis. This work proposes the Advanced AI models that use multimodal data for early detection and diagnosis of oral cancer. Currently, traditional machine learning algorithms coupled with deep learning algorithms such as Convolutional neural networks (CNNs), focus on image-based analysis for detecting cancer. These works are delimited with minimal robustness and input data efficacy. Through the proposed multimodal AI model, histopathological images and clinical notes of the oral cancer patients are combinedly analyzed by which diagnostic accuracy is enhanced. This framework integrates CNN s for image analysis and Transformer-based models for text analysis, with a sophisticated fusion layer for data integration. Enhanced preprocessing techniques and performance optimization through Vision Transformers (ViTs) and BERT models significantly improve sensitivity, specificity, and Fl-score. The multimodal AI model achieved a sensitivity of 0.90, specificity of 0.85, and an Fl-score of 0.89, outperforming previous models like SVMs, RF, and CNNs. This indicates a high accuracy in identifying both positive and negative cases, ensuring reliable diagnoses. The results demonstrate a substantial improvement over traditional methods, that lays foundations for early diagnosis.