7 ms·
I can see how determinism can be achieved (not easy, but possible), and I can see how describing a few important system invariants can match 100's or 1000's of
by mamidon 3y ago
I can see how determinism can be achieved (not easy, but possible), and I can see how describing a few important system invariants can match 100's or 1000's of hand rolled tests, but I'm having a hard time understanding how it's possible to intelligently explore the inputs to generate.
e.g. if I wrote a compiler, how would Antithesis generate mostly valid source code for it? Simply fuzzing utf8 inputs wouldn't get very far.
- chinchilla2020 3y agoThe blog post has some impressive copy but is lacking details on how you implement their product. I am highly skeptical of any claims that something 'magically just works' without much configuration or setup.
- intuitionist 3y ago(Disclosure: I’m an Antithesis employee.) The blog post is meant as a high-level introduction for a general audience. The documentation (https://antithesis.com/docs/ https://antithesis.com/docs/) goes into considerably more detail about what kind of configuration and setup you need to start testing with Antithesis.
- pfdietz 3y agoI don't know how they'd do compiler testing, but I know how I do it (testing Common Lisp), and can talk about that if you're interested. But it would be cool to hear how they'd do it.