Since in bagging/random forest we are averaging over many models obtained by bootstrapping the original dataset, the
Fantastic news! We've Found the answer you've been seeking!
Question:
Since in bagging/random forest we are averaging over many models obtained by bootstrapping the original dataset, the resulting average prediction is NOT expected to overfit, even while each individual tree in the ensemble might overfit on its respective bootstrapped dataset.
True
False
Posted Date: