added README to numpy-nn

Author: voorhs

numpy-nn/README.md

@@ -0,0 +1,21 @@
+# Custom NN Modules with Numpy
+
+**Implemenation.**
+`layers.py` Numpy implementation of the following modules:
+- ReLU
+- Tanh
+- Sigmoid
+- Linear (Dense)
+- LogSoftmax
+
+`loss.py` Negative log likelihood.
+
+**Optimizer.** I used `scipy.optimize.minimize` function with `L-BFGS-B` method.
+
+**Experiments.** 
+
+![](figures/layers.png)
+
+![](figures/init.png)
+
+![](figures/actfn.png)