5 ms·

"small changes in the hyperparameters can lead to large changes in training dynamics" This is the definition of Chaos though no? Butterfly flaps its wings, hur

"small changes in the hyperparameters can lead to large changes in training dynamics" This is the definition of Chaos though no? Butterfly flaps its wings, hurricane on other side of the planet...

paulrudy 3y ago
As far as I am aware, these kinds of nonlinear relationships are a feature of fractal dynamics, but I'm not a mathematician.