A Python Library with Fast Algorithms for Popular Entropy Definitions

We present “fastEntropyLib”, a set of Python functions, organized as a library, to facilitate the computation of popular definitions of entropy, used in biomedicine. Entropy estimation is a powerful tool in non-linear analysis. However, the computation of the most common entropy metrics is time consuming, an inhibitor, especially when large amount of data is to be processed. The library includes the most common definitions of entropy: Shannon, Renyi, Approximate, Sample Entropy, as well as the more recently proposed Bubble Entropy, an entropy almost free of parameters. What makes this library different from other similar Python libraries is the employment of fast algorithms for the implementation of Approximate, Sample Entropy and Bubble Entropy. For both Approximate and Sample Entropy, the Bucket Assisted and Lightweight algorithms have been employed. These two algorithms speed up the computation significantly by excluding similarity comparisons, which we know in advance will fail. Even though bubble sort is a quadratic algorithm, the computation of Bubble Entropy is done in linear time, exploiting, in each step, already sorted vectors. Since speed is the weak point of Python, we selected to implement all algorithms in C and add a Python wrapper on top of them. In this way, we exploit both the speed of C and the convenience and popularity of Python.