Loading web-font TeX/Math/Italic
Fast LDP-MST: An Efficient Density-Peak-Based Clustering Method for Large-Size Datasets | IEEE Journals & Magazine | IEEE Xplore

Fast LDP-MST: An Efficient Density-Peak-Based Clustering Method for Large-Size Datasets

CodeAvailable

Abstract:

Recently, a new density-peak-based clustering method, called clustering with local density peaks-based minimum spanning tree (LDP-MST), was proposed, which has several at...Show More

Abstract:

Recently, a new density-peak-based clustering method, called clustering with local density peaks-based minimum spanning tree (LDP-MST), was proposed, which has several attractive merits, e.g., being able to detect arbitrarily shaped clusters and not very sensitive to noise and parameters. Nevertheless, we also found the limitation of LDP-MST in efficiency. Specifically, LDP-MST has O(N\log N+M^{2}) time, where N denotes the dataset size and M is an intermediate variable denoting the number of local density peaks. As our experimental results reveal, when processing large-size datasets, the value of M could be very large and consequently those steps of LDP-MST involving O(M^{2}) time term would be time-consuming. And in the worst case, the value of M could be very close to that of N, which means that the time complexity of LDP-MST could be O(N^{2}) in the worst case of M. In this study, we use more efficient algorithms to implement those steps of LDP-MST that involve the O(M^{2}) time term such that the proposed method, Fast LDP-MST, has O(N\log N) time complexity even if M\approx N. Our experiments demonstrate that Fast LDP-MST is overall more efficient than LDP-MST on large-size datasets, without sacrificing the merits of LDP-MST in effectiveness, robustness, and user-friendliness.
Published in: IEEE Transactions on Knowledge and Data Engineering ( Volume: 35, Issue: 5, 01 May 2023)
Page(s): 4767 - 4780
Date of Publication: 11 February 2022

ISSN Information:

Funding Agency:


This article includes code hosted on Code Ocean, a computational reproducibility platform that allows users to view, modify, run, and download code included with IEEE Xplore articles. NOTE: A Code Ocean user account is required to access functionality in the capsule below.
Contact IEEE to Subscribe