Activation functions are the building blocks for simple neural networks and the complex deep learning network architectures.
People tend to use these activation functions like try and error type while building deep learning networks.
But if you learn the properties of these activation function, you will know which activation function has to use where.
The article listed the popular activation functions used in the industry. If we miss any, do let us know, we would love to include that in the article.