Hardware Implementation of Sigmoid Activation Functions using FPGA

The methods of approximation of the sigmoid function are developed and modified, using piecewise linear approximation and approximation by a second order polynomial. The estimation of the accuracy of approximation by these methods of sigmoid function and its derivative is performed. The considered methods are implemented on FPGA using VHDL. The comparison of the required hardware resources and performance is given.