6 ms·

Training takes many years though.

• namaria 2y ago
  Training took hundreds of thousands of years. Everyone just gets a foundation model to fine tune for another couple of decades before it can start flipping burgers.
  • thfuran 2y ago
    It's been something like half a billion years since the first brain.
    • namaria 2y ago
      That was a much smaller model, couldn't do much more than crawl around and run away.
      • thfuran 2y ago
        It was still used as part of pretraining the current model.
        • namaria 2y ago
          Nonsense, the current model is a new architectural approach. It was all explained in that recent paper, "Attention is all your meat"