mikebs1

5 ms·

1. 1.▲
   by mikebs1 2mo ago

   Evaluation gaming is a benchmarking footnote; for autonomous ops tooling where the model acts on production systems, it's a deployment blocker.
2. 2.▲
   by mikebs1 2mo ago

   The variable missing from cost-per-task: which tasks shouldn't be hitting an external API at all.
3. 3.▲
   by mikebs1 2mo ago

   In production operations this plays out concretely. The systems that hold up under incident pressure are almost always the simple ones. Clever optimizations are the first things to behave unexpectedly at 2am.