Activation Functions: All neural network layers’ outputs must get passed through activation functions. These are usually non-linear and allow a neural network to learn even highly non-linear output mappings from input. This post tries to serve as a central place to get a graphical understanding of most common activation function in neural networks. I am…