5 ms·
The human equivalent to GPT-3 training is not as much the learning one has in a lifetime, but the millions of years evolution process. "Normal" human learning i
by hnrq 6y ago
The human equivalent to GPT-3 training is not as much the learning one has in a lifetime, but the millions of years evolution process. "Normal" human learning is more akin to finetunning I think, although these analogies are flawed anyway.
- roca 6y agoObviously the genome encodes what you need to grow a brain, but, there aren't enough bits in the human genome to encode many neural network weights.
- hnrq 6y agoGood point. By this logic, evolution is more about creating the best architecture, which I think is also a good analogy. But I also think that a lot of the brain's "weights" are pretty much set before any experience (maybe less so in humans, but several animals are born pretty much ready, even ones with complex brains, like whales), the genome information is, in a sense, very compressed, so even if isn't setting individual weights, it does determine the weights somehow, I think. Does anyone know if anyone has investigated these questions more seriously elsewhere?