6 ms·

Door A: tests find bugs sometimes (property-based) Door B: tests find bugs almost always with a fraction of the code (my approach) I choose Door B. I still t

Door A: tests find bugs sometimes (property-based) Door B: tests find bugs almost always with a fraction of the code (my approach) I choose Door B. I still test properties tbh. I just don’t let randomness ruin it and don’t need to implement any shrinking.

bluGill 3y ago
This is not an exclusive choice. Choose all doors as each will gike you something the others don't. All includes things not yet invented.
- GrumpySloth 3y ago
  I have a finite budget of code and time I can afford to spend. One of the choices gives me a much better RoI in my experience. I prefer to spend the rest of the budget on the main code.
eru 3y ago
Python's Hypothesis automatically saves the random seeds that find counterexamples, so the next time you run your test suite, you can reproduce that bug.
- mrkeen 3y ago
  If your code does the same thing every time it's run.
  - eru 3y ago
    Sure. But that's a problem with running any test suite (property based or otherwise).
    - mrkeen 3y ago
      In other words: Python's Hypothesis automatically saves the random seeds that find counterexamples, so the next time you run your test suite, you may or may not be able to reproduce that bug.