Answered step by step
Verified Expert Solution
Question
1 Approved Answer
In this simplified version of the SGD update there is a clear relationship between momentum and the batch size . What is that relation? Specifically,
In this simplified version of the SGD update there is a clear relationship between momentum and the batch size What is that relation? Specifically, let's assume we train a model with momentum and a batch size How should we change the momentum if we now have a GPU with more memory and can use a batch size of Specify the momentum that would lead to equivalent gradient updated in the simplified SGD update equation above. Round to two decimal digits eg
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started