Module 1
Neural network basics
Explain how a small network learns, and build one from scratch.
- Perceptron and feedforward networks
- Activation functions: ReLU, sigmoid, softmax
- Loss functions: mean squared error and cross-entropy
- Gradient descent and backpropagation
PythonNumPy
Practice: A tiny neural network written with NumPy only
