9 ms·
Is there any resource or benchmark actually comparing how different harnesses perform with a given model? Really just feels like endless FOMO with how fast the
by seaal 2mo ago
Is there any resource or benchmark actually comparing how different harnesses perform with a given model?
Really just feels like endless FOMO with how fast the iteration cycle is for harness and model development.
- shepherdjerred 2mo agoI found this: https://artificialanalysis.ai/agents/coding-agents#harness-comparison https://artificialanalysis.ai/agents/coding-agents#harness-c... I don't think it's very good though. As an example I can use one CC instance to delegate to several to achieve complicated/open-ended goals. That just isn't possible with other harnesses, and it's definitely not benchmarked.