Feedforward networks, Loss functions, Back-propagation training, Regularization, Convolutional neural networks (CNN), Transfer learning, Recurrent and recursive networks (RNN), Vanishing gradient problem, Long-short term memory (LSTM) model, Gated recurrent units (GRUs), Auto-encoders, Transformers, and Generative adversarial networks.

Pre-requisites: (COE292 Or ICS381*) And (MATH208 Or MATH260 Or MATH202 Or ICS254) And STAT319

Co-requisites: ICS 381