Test flakiness refers to the non-deterministic behavior of software tests. A flaky test may pass or fail without changes to the test case code or the code under test. This leads to decreased developer productivity, expensive and excessive retrying of tests, bugs masked or missed by persistent flakiness, and loss of developer trust in test suites. Despite the problem receiving increasing attention from both practitioners and researchers over the past decade, no workshop dedicated to flakiness had been established.
No takes yet. Share an insight, caveat, or question.
Parry et al. (2024) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: