Lecture 10 Recurrent neural networks
www.cs.toronto.edu › ~hinton › csc2535Recurrent neural networks • RNNs are very powerful, because they combine two properties: – Distributed hidden state that allows them to store a lot of information about the past efficiently. – Non-linear dynamics that allows them to update their hidden state in complicated ways. • With enough neurons and time, RNNs