Read a sequence one step at a time, carrying a memory forward; LSTMs decide what to keep.
- Step inRead one word or time step.
- Hidden stateCarry a summary of everything so far.
- GatesLSTM gates choose what to forget, store and output.
- OutputPredict the next word or a label for the whole sequence.
Explain 1/5
Source: Understanding LSTM Networks (colah)