5 ms·
> gives me the impression that anything other than grid search hyper parameter optimization is a fools errand. This would give credence to the notion that hyper
by krallistic 3y ago
> gives me the impression that anything other than grid search hyper parameter optimization is a fools errand. This would give credence to the notion that hyper parameter tuning really is akin to just re-rolling a character sheet until you get one that is over powered.
The visualizations only show that at the Border there are a lot of fractals, not in every part of the space.
(Although the highest performance is often achieved close to the border.). I would not state hparam search as bad as that..