NeuralNet

Description

Modular Neural Network Implementation in C++ with examples and some Python analysis of Training a Net and using different optimizers.

Contents

• Cost functions

  • Mean Absolute Error
  • Mean Squared Error
  • Cross Entropy

• Initializers

  • He Initialization
  • Xavier Initialization

• Layers

  • Fully Connected

  • Activation Functions

    • Sigmoid
    • Tanh
    • ReLU
    • Leaky ReLU
    • Softmax

• Optimizers

  • Gradient Descent
  • Momentum
  • Nesterov
  • RMSProp
  • Adam