oliver_dr

6 ms·

1. 1.▲
   by oliver_dr 6mo ago

   The framing of "benchmarks measure capability, we measure reliability" resonates. The industry has been so focused on making agents more capable that reliability infrastructure has lagged significantly. One gap I'd push on: P
2. 2.▲
   by oliver_dr 6mo ago

   Nice approach. The "don't trust an LLM to guard another LLM" principle is sound for tool-call safety specifically, where the threat model is well-defined (destructive commands, SSRF, path traversal, etc.) and pattern matching
3. 3.▲
   by oliver_dr 6mo ago

   This is almost certainly a server-side session isolation bug rather than an LLM hallucination - the model is returning a response to someone else's prompt. The DeepSeek cloud endpoints have had documented issues with request routing un
4. 4.▲
   by oliver_dr 6mo ago

   We've been dealing with this at multiple layers. Here's what actually works in production: Input-side (preventing injection): - Strict input sanitization with role-boundary enforcement in the system prompt. Sounds basic, but most