5 ms·
i've always wondered (for this, portkey, etc) - why not have a parallel option that fires an extra request instead of mitm the llm call?
by nicklo 8mo ago
i've always wondered (for this, portkey, etc) - why not have a parallel option that fires an extra request instead of mitm the llm call?
- ofabioroma 8mo agoYou can fire them in parallel for simple cases. The issue is when you have multi-agent setups. If context isn't persisted before a sub-agent reads it, you get stale state. Single source of truth matters when agents are reading and writing to the same context. For single-agent flows, parallel works fine.