Activation functions applied to neurons of the whole layer. Per-neuron activation function setting is not supported. More...
#include <Activation_Functions.h>
Classes | |
struct | Function |
Holds enumeration of all available functions. More... | |
struct | Pair |
Structure that holds pointers to function and its derivative for convenient use. More... | |
Public Types | |
typedef double(* | Function_Ptr )(double) |
function pointer type for activation function and its derivative. | |
Public Member Functions | |
Activation_Functions () | |
Constructor. | |
const Pair * | operator[] (const Function::Type index) const |
Allows to get the activation function and its derivative (in the form of Pair*) by index. | |
Static Public Member Functions | |
static double | tanh (double x) |
Hyperbolic tangent. | |
static double | tanh_derivative (double tanh_value) |
Hyperbolic tangent first derivative. Please note that tanh_value = tanh(x)! | |
static double | pass_through (double x) |
y(x) = x. | |
static double | pass_through_derivative (double x) |
First derivative of ( y(x) = x ) which is always 0. |
Activation functions applied to neurons of the whole layer. Per-neuron activation function setting is not supported.