10 ms·

Absolutely. Gemini results tend to drop off after 128k tokens according to RULER: https://github.com/hsiehjackson/RULER https://github.com/hsiehjackson/RULER

• ayyndrew 2y ago
  If I'm reading the paper right, it says Gemini 1.5 is good up to 128k, and RULER doesn't test beyond 128k
  • cathalc 2y ago
    Hmm perhaps you are right.. There's no context on the page about what ">128k" means so possibly a bad assumption on my part!