TED-RNN | Recurrent Neural Network trained on all existing TED Talk | Machine Learning library
kandi X-RAY | TED-RNN Summary
kandi X-RAY | TED-RNN Summary
A Recurrent Neural Network trained on all existing TED Talk Transcripts. The model outputs machine generated TED Talks.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Get the text of theTEDTalk .
TED-RNN Key Features
TED-RNN Examples and Code Snippets
Community Discussions
Trending Discussions on TED-RNN
QUESTION
I'm trying to figure out how to backpropagate a GRU Recurrent network, but I'm having trouble understanding the GRU architecture precisely.
The image below shows a GRU cell with 3 neural networks, receiving the concatenated previous hidden state and the input vector as its input.
This image used I referenced for backpropagation, however, shows the inputs being forwarded into W and U for each of the gates, added, and then having their appropriate activation functions applied.
the equation for the update gate shown on wikipedia is as shown here as an example
zt = sigmoid((W(z)xt + U(z)ht-1))
can somebody explain to me what W and U represent?
EDIT:
in most of the sources I found, W and U are usually referred to as "weights", so my best guess is that W and U represent their own neural networks, but this would contradict the image I found before.
if somebody could give an example of how W and U would work in a simple GRU, that would be helpful.
Sources for the images: https://cran.r-project.org/web/packages/rnn/vignettes/GRU_units.html https://towardsdatascience.com/animated-rnn-lstm-and-gru-ef124d06cf45
...ANSWER
Answered 2020-Jan-29 at 00:00W
and U
are matrices whose values are learnt during training (a.k.a. neural network weights). The matrix W
multiplies the vector xt
and produces a new vector. Similarly, the matrix U multiplies the vector ht-1
and produces a new vector. Those two new vectors are added together and then each component of the result is passed to the sigmoid
function.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install TED-RNN
You can use TED-RNN like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page