Activation functions applied to neurons of the whole layer. Per-neuron activation function setting is not supported. More...
#include <Activation_Functions.h>
Classes | |
| struct | Function |
| Holds enumeration of all available functions. More... | |
| struct | Pair |
| Structure that holds pointers to function and its derivative for convenient use. More... | |
Public Types | |
| typedef double(* | Function_Ptr )(double) |
| function pointer type for activation function and its derivative. | |
Public Member Functions | |
| Activation_Functions () | |
| Constructor. | |
| const Pair * | operator[] (const Function::Type index) const |
| Allows to get the activation function and its derivative (in the form of Pair*) by index. | |
Static Public Member Functions | |
| static double | tanh (double x) |
| Hyperbolic tangent. | |
| static double | tanh_derivative (double tanh_value) |
| Hyperbolic tangent first derivative. Please note that tanh_value = tanh(x)! | |
| static double | pass_through (double x) |
| y(x) = x. | |
| static double | pass_through_derivative (double x) |
| First derivative of ( y(x) = x ) which is always 0. | |
Activation functions applied to neurons of the whole layer. Per-neuron activation function setting is not supported.