mpolson64

5 ms·

1. 1.▲
   by mpolson64 7mo ago

   The concern about the dimensionality of the search space is real, especially once things cross over into the 100s -- BO would certainly not be useful post-training the way the blog post talks about using SPSA. That being said, it still seem
2. 2.▲
   by mpolson64 7mo ago

   DOE is still very useful in many contexts, but when it's possible do use a sequential design these adaptive techniques really start to pull away in terms of optimization quality. There's simply a lot of sample efficiency to gain b
3. 3.▲
   by mpolson64 7mo ago

   I'm no expert on chess engine development, but it's surprising to me that both lc0 and stockfish use SPSA for "tuning" the miscellaneous magic numbers which appear in the system rather than different black box optimizati
4. 4.▲
   Efficient Optimization with Ax, an Open Platform for Adaptive Experimentation(engineering.fb.com)

   2 points by mpolson64 10mo ago|0 comments