8 ms·

This benchmark is shitty because it puts Gemini in 3rd position. I tried gemini on simple code base and it invoked 210 tool calls just to update 3 lines of cod

This benchmark is shitty because it puts Gemini in 3rd position. I tried gemini on simple code base and it invoked 210 tool calls just to update 3 lines of code.