Introduction to Recurrent Neural Networks

• Why Recurrent Neural Networks (RNNs)?? • The Vanilla RNN unit? • The RNN forward pass? • Backpropagation refresher? • The RNN backward pass? • Issues with the Vanilla RNN? • The Long Short-Term Memory (LSTM) unit? • The LSTM Forward & Backward pass? • LSTM variants and tips? – Peephole LSTM? – GRU?