Notebook: parameter_tuning_randomized_search
Also, the grid will imposed a regularity during the search which might be problematic.
What does imposed regularity mean?
I will show the figure from the notebook to be more explicit:
The search performed with a grid-search is regular in the sense that you try the only combinations of parameters that you provided in param_grid. As a consequence, you will cover the hyperparameter space regularly as shown by the blue circle (note that this example is extreme because the blue circles do not create little squares in practice but they would be rectangles for sure or hyperrectangle in higher dimensionality).
So in short, “imposed regularity” refers to this rectangle-like coverage of the hyperparameter space.
1 Like