You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Use a fixed sized architecture for the MLP (for example, single hidden layer with 10 neurons using logistic activation function).
Consider meta-heuristic algorithms PSO, FA and CS. Hyper-parameter configuration of such algorithms should be archived by using Random Search.
Consider the gradient based algorithms: SGD and ADAM provided by skit-learn. Hyper-parameter configuration of such algorithms should be archived by using Random Search.
Take a look to hyper-opt to perform hyper-parameter configuration.
The output of this issue should be a new folder within docs directory.
Name the new directory as: docs/bench-accuracy
Include within this folder the mlp-sgd-vs-meta.ipynb and mlp-sgd-vs-meta.html notebook.
We need to create a notebook to compare gradient based training of MLP networks with meta-heuristic training. We suggest to proceed as follows:
The output of this issue should be a new folder within
docsdirectory.docs/bench-accuracymlp-sgd-vs-meta.ipynbandmlp-sgd-vs-meta.htmlnotebook.