Discovering Reliable Information Extraction Patterns with Pre-Trained Model for Text with Writing Style

Large-scale pre-trained models such as GPT and BERT have demonstrated remarkable performance in information extraction tasks. However, their black-box nature poses challenges for reliability and interpretability. In contrast, rule- based extraction methods have better interpretability, but typically require domain experts to manually establish rules, limiting their generalization ability. In industry, there is often a demand for reliable knowledge extraction to reduce the time spent on manual verification of each piece of knowledge. In this paper, we explore the idea of combining GPT and symbolic-based methods to automatically discover reliable extraction patterns in text with a particular writing style. This method leverages the characteristics of high information density and similar writing patterns in text with a specific writing style to generate verifiable and reliable patterns. We conduct experiments on two datasets with a specific writing style to demonstrate its effectiveness, validating the idea of combining large models for reliable information extraction pattern discovery in the tested datasets.