De-duplication framework to reduce the record linkage problem

User profiling plays a very crucial role in government organizations. Fraudulent cases occur due to multiple representations of user profile for a single user. Record linkage or record matching is nothing but data duplication detection process to eliminate redundancy from the database. In data cleaning phase, stop words, missing values, inconsistent values are removed from the data. Therefore, de-duplication is the important step in data cleaning. In this paper, we proposed a data de-duplication framework for efficient data cleaning.