Research on data migration optimization of ceph

Benefiting from its excellent performance and scalability, Ceph distributed storage is also confronting the problems, i.e. the unnecessary transfer of the data leading to the increasing consumption of the system which is triggered by the additions and deletions on the equipment. Aiming at the implement method of Ceph in system algorithm and logical layout, this paper has carried on research, analyzing its defects in the aspect of data transfer and resource consumption and puts forward the handling method of the failure node when the cluster storage device fails. Through the establishment of the cluster device flag in the process of data transfer, the optimized scheme of the data migration in the environment of production is realized, and the utilization of the system resources is improved. The experimental test results have shown that the scheme can reduce about the 30% -40% of transfer volume, effectively lower the resources consumption of Ceph distributed storage, as well as prevent invalid and excessive data transfer.