7 ms·What’s the context size?by dcastm 20d agoWhat’s the context size?seanmcdirmid 20d ago128k, 256k is also possible, but my tok/s drops off and the performance isn’t good.