5 ms·

What methods make BERT outdated? Do you have pointers to other options?

• bitL 7y ago
  e.g. XLNet: https://arxiv.org/abs/1906.08237 https://arxiv.org/abs/1906.08237
  • phreeza 7y ago
    XLnet is Bert with a bunch of additional training tricks.
    • bitL 7y ago
      BERT is a Transformer with a bunch of additional training tricks. Transformer is self-attention with a bunch of additional training tricks...