Which of the following statement about Overfitting is False?

Overfitting occurs when a statistical model or machine learning algorithm captures the noise of the data.

Overfitting is a modeling error which occurs when a function is too closely fit to a limited set of data points.

One way to avoid overfitting is to limit complexity of the model

Overfitting leads to low accuracy of training data set, but high predictive performance of new data