Tests and Bugs
Discussions center on the limitations of software tests, which detect but do not prevent or fix bugs, can contain bugs themselves, and are sometimes incorrectly modified to pass instead of addressing core issues.
Activity Over Time
Top Contributors
Keywords
Sample Comments
It usually happens when tests are not fixed.
Tests always have bugs, it's just that you don't know about the edge cases yet.
Tests just give you a bug report early, they don't fix the bug.
Not always the case. It’ll just go and “fix” the tests to pass instead of fixing the core issue.
If your tests don't exercise a bug, is it still there?
Tests are also code and can be buggy, incomplete etc.
When they're not modifying the tests to match buggy behavior. :P
What are your "regression tests" and why are you only worried about those?
Dry run really is key here. Most automated tests wouldn't find this bug.
What if the bug fix is right and the tests are wrong?