Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Which of the statements below regarding bagging/random forest approaches is the most accurate? Group of answer choices A) In these approaches we first fit a

Which of the statements below regarding bagging/random forest approaches is the most accurate?

Group of answer choices

A) In these approaches we first fit a deep (likely overfitting) tree to the data, as tightly as we can, then introduce additional term into the score function that penalizes the number of leaves in the tree (i.e. the number of the resulting regions); next, we minimize such modified score function by trying to remove different splits from the tree. A collection of such trees obtained for different penalties is a random forest, and we make the prediction by takingthe predictions of each such differently penalized model and averaging them.

B) In these approaches we first fit a deep (likely overfitting) tree to the data, as tightly as we can, and then repeatedlybootstrap that model, by randomly selecting different combinations and orders of the splits (i.e. the branching nodes) from that tree. We hope that by trying different splits in different orders, with replacement, and averaging predictions of the resulting models, we can obtain a better overall prediction

C) In these approaches we repeatedly search for the best possible fit to different bootstrapped datasets. As the result, different aspects and features of the data are randomly in or out of, or more or less prominent in, any particular bootstrapped dataset Di used to train model Mi. This mimics, to a certain extent, drawing a new sample every time from the true underlying distribution (assuming the original sample we have at hand is representative of course!), so by repeating this procedure and averaging the predictions of models Mi we expect obtaining a better prediction.

D) In these approaches we repeatedly search for different somewhat imperfect fits to the data we have at hand. We hope that while each model Mi is deliberately imperfect, they might have smaller variance and by averaging the predictions of all these models we can get a better prediction at the end.

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Linear Algebra With Applications

Authors: Jeffrey Holt

2nd Edition

1319057691, 9781319057695

More Books

Students also viewed these Mathematics questions

Question

10. What is meant by a feed rate?

Answered: 1 week ago

Question

1. What does this mean for me?

Answered: 1 week ago