ilyasut

5 ms·

1. 1.▲
   by ilyasut 7y ago

   Comments like this are what make HN great and are not at all toxic!
2. 2.▲
   by ilyasut 8y ago

   We have to raise a lot money to get a lot of compute, so we've created the best structure possible that will allow us to do so while maintaining maximal adherence to our mission. And if we actually succeed in building the safe AGI, we
3. 3.▲
   by ilyasut 8y ago

   Ilya from OpenAI here. Here's our thinking: - ML is getting more powerful and will continue to do so as time goes by. While this point of view is not unanimously held by the AI community, it is also not particularly controversial. -
4. 4.▲
   by ilyasut 8y ago

   There has been a fair bit of past work exploring the idea you described (examples: https://arxiv.org/pdf/1606.01868.pdf , https://arxiv.org/pdf/1703.01310.pdf , https://pathak22.github.i
5. 5.▲
   by ilyasut 8y ago

   Correction: see https://news.ycombinator.com/item?id=17394916
6. 6.▲
   by ilyasut 8y ago

   EDIT (I work at OpenAI and wrote the statement about the variance of the gradient being linear): Here's a more precise statement: the variance is exponential in the "difficulty" of the exploration problem. The harder the ex
7. 7.▲
   by ilyasut 8y ago

   Re variance, the argument is not entirely bullet proof, but it goes like this: we know that the variance of the gradient of ES grows linearly with the dimensionality of the action space. Therefore, the variance of the policy gradient (bef