Bidirectional recurrent neural networks - Wikipedia
https://en.wikipedia.org/wiki/Bidirectional_recurrent_neural_networksBidirectional recurrent neural networks (BRNN) connect two hidden layers of opposite directions to the same output. With this form of generative deep learning, the output layer can get information from past (backwards) and future (forward) states simultaneously. Invented in 1997 by Schuster and Paliwal, BRNNs were introduced to increase the amount of input information available to the network. For example, multilayer perceptron (MLPs) and time delay neural network(TDNNs) have …
LSTM - GeeksforGeeks
https://www.geeksforgeeks.org/lstm-derivation-of-back-propagation...01.08.2020 · LSTM (Long short term Memory ) is a type of RNN(Recurrent neural network), which is a famous deep learning algorithm that is well suited for making predictions and classification with a flavour of the time.In this article, we will derive the algorithm backpropagation through time and find the gradient value for all the weights at a particular timestamp.