Deep Learning

Learning Outcomes

Understand how to use linear discriminant analysis

You understand

what is a perceptron, multi-layer perceptron
how gradient descent and backpropagation is used to train a neural network
recurrent neural networks and long short term memory networks
autoencoders and convolution neural networks
how to apply neural networks to various classification problems

Readings

A Deep Learning Tutorial

From Perceptrons to Deep Networks

Web Tutorial

Neural Computation 2006

A fast learning algorithm for deep belief nets

Academic Paper

Deep Learning (2015)

Nature, Vol. 521, pp 436-444

Nature Article

A practical guide to training restricted Boltzmann machines

Geoff Hinton

Tech Report

A Tutorial on Deep Learning

Part 2: Autoencoders, Convolutional Neural Networks and Recurrent Neural Networks

Tutorial (PDF)

Long Short Term Memory

Understanding RNN & LSTM networks

Web article

But what is a neural network?

Deep Learning Ch 1

Youtube Video (19min)

Gradient Descent: how neural networks learn

Deep Learning Ch 2

Youtube Video (21min)

What is backpropagation?

Deep Learning Ch 3

Youtube Video (14min)

Recent Developments in Deep Learning (2010)

Google Tech Talk

Youtube Video

NN, RNN, LSTM, Autoencoders, Deep Networks

Slides

Convolution Neural Networks

Image Classification using CNN