A Cloud based Improved File Handling and Duplicate Removal using MD5

In the era of data duplication, the document checksum approach is commonly used to quickly and accurately identify redundant information. The calculated value of numbers and letters used to validate the validity of a file's contents It can determine whether duplicate data exists. However, there are numerous deficiencies. They have a longer processing time, a chance of misleading results, are not user-friendly, and are tough to maintain. The primary objectives of this research work is to minimise the number of duplicates in the cloud database, maximise the process performance to the point where the backup window is slightly impacted, and design with horizontal scaling in mind so that it runs competitively on a cloud platform. The proposed MD5 method outperforms the current best practises.