5 ms·
I’m spending a significant portion of my day waiting for agents to execute. What’s more interesting to me than time-to-first token or latency is the time it ta
by owenbrown 2mo ago
I’m spending a significant portion of my day waiting for agents to execute.
What’s more interesting to me than time-to-first token or latency is the time it takes for the agent to execute, from starts to finish, excluding when it’s waiting on a human.
- madaxe_again 2mo agoSubagents can help enormously… On which note I recently convinced codex to use the ChatGPT web client to run subagents. Means I only pay for the slavemaster, and all the slaves I can eat for $20 a month. Actually works surprisingly well - I currently have it crunching through a large dataset, which would have taken weeks on a single thread - started last night, nearly done this morning. $20.