9 ms·Yes! Both Llama 3 and Gemma 3 have 128k context windows.by sethkim 1y agoYes! Both Llama 3 and Gemma 3 have 128k context windows.ryao 1y agoLlama 3 had a 8192 token context window. Llama 3.1 increased it to 131072.