Which of the following statements are correct about hyperparameter tuning?

Hyperparameters tuning is done on the test set.

Grid search and randomized search methods can be used to perform hyperparameter tuning.

Tuning does not have a significant effect on the models performance

Choosing optimal hyperparameters can lead to improvements in the overall models performance

1, 2 and 3

1, 3 and 4

2 and 4

1 and 2