From the course: Deep Learning with Python and Keras: Build a Model for Sentiment Analysis
Join today to access over 24,900 courses taught by industry experts.
Long memory cells
From the course: Deep Learning with Python and Keras: Build a Model for Sentiment Analysis
Long memory cells
- [Instructor] When you work with recurrent neural networks, you find that recurrent neurons suffer from an important shortcoming. They suffer from short-term memory. If you remember the hidden state in a recurrent neuron is referred to as the memory of a neuron. This hidden state of a recurrent neuron is what keeps track of all of the inputs that occurred in the sequence before the current input. And this is what allows the recurrent neurons to extract time relationships that exist in the data. This is what allows recurrent neurons to remember the past, and the past here can be word sequences that occurred before the current word in the case of natural language processing or data points that occurred before the current instance in time. However, the memory capacity of regular recurrent neurons is not very large, which means they cannot remember sequences from very far back in time. If you have long input sequences, your…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.