4 ms·
The argument in the article is backwards. Evals test the stability and boundaries of a concept. They are not created before the concept has been prototyped (whi
by ppeetteerr 4mo ago
The argument in the article is backwards. Evals test the stability and boundaries of a concept. They are not created before the concept has been prototyped (which the author acknowledges).
An eval is not somehow breaking silently due to some new capabilities in an LLM. It wouldn't be a good eval if it did. What it does is steer the LLM towards specific goals. If anything, an argument can be made that they restrict creativity and experimentation by narrowing goals.
If the argument is that evals need to written before some new behavior can be devised, that's incorrect. There are an infinite number of evals that test for things which cannot be done. Only when something has been demonstrated to work in a specific context, can an eval be written.
- rajveerb 4mo agoMost of these are addressed?
- ppeetteerr 4mo agoThey are addressed but the core of the thesis is still wrong: > This is the core problem: our entire evaluation infrastructure is structurally reactive. We measure the system after it has changed. We never predict the change. That's kind of the point of evals.