The Most Used Activation Functions: Classic Versus Current

This paper is an overview of the most used activation functions, classic functions and current functions as well. When we say classic, we mean the first activation functions, the most popular and used in the past. But due to their disadvantages appeared other new activation functions that we refer them as current. These most influential functions are among the most known artificial intelligence activation functions in the research of Machine...