Neural Network

Perceptron

Backpropagation

Learning internal representations by error propagation (Nature 1986)
Algorithm used to learning the parameters of neural network to minimize the loss
Math: find the derivation of loss

Optimizer

Optimizer
optimized the cost

Stochastic, Batch, Min-Batch