Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Your team member suggested to use LSTM instead of RNN for sentiment analysis project, where LSTM cell is defined as i t = ( W

Your team member suggested to use LSTM instead of RNN for sentiment analysis project, where LSTM cell is defined as
it=(W(i)xt+U(i)ht-1)
ft=(W(f)xt+U(f)ht-1)
ot=(W(o)xt+U(o)ht-1)
tilde(c)t=tanh(W(c)xt+U(c)ht-1)
ct=ft@ct-1+it@tilde(c)t
ht=ot@tanh(ct)
i) What should be the values of input gate and forget gate if you want the cell ct to sum its inputs over time.?
If the forget gate is set to 1 for a cell dimension and the input gate set to 0, then the information of that cell is preserved indefinitely.
ii) Derive the gradient delJdelU(c) in terms of the following gradients: delhtdelht-1,delht-1delU(c), delJdelht,delctdelU(c),delct-1delU(c),delctdelct-1,delhtdelct, and delhtdelot. Do not calculate the individual gradients. You can leave the answer in form of chain rule.
Solve the (ii) question full explanation.
image text in transcribed

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

SQL Antipatterns Avoiding The Pitfalls Of Database Programming

Authors: Bill Karwin

1st Edition

1680508989, 978-1680508987

More Books

Students also viewed these Databases questions

Question

What is cultural tourism and why is it growing?

Answered: 1 week ago