Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

send to expert Given a 4 length sequence RNN , compute d e l L 2 d e l b and show how you derived

send to expert Given a 4 length sequence RNN, compute delL2delb and show how you derived it. In
addition, please provide its computation graph.
The following equations might be helpful:
at=Uxt+Wht-1+b
ht=tanh(at)
ot=Vhht+c
hat(y)t=Softmax(ot)
Lt=CE(hat(y)t,yt)
f(x)=tanh(x)longrightarrowf'(x)=1-tanh2(x)
Hint: You can combine softmax and CE into a single derivative as follows:
delLtdelot=hat(y)t-yt
image text in transcribed

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access with AI-Powered Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Students also viewed these Databases questions