Test suites are hard to maintain. They're slow, brittle, and flaky. Even worse, flaky tests can lead to a lack of confidence in your test suite. Modern CI tooling will happily tell you that something broke, but it won't tell you the underlying root causes, patterns, or trends. Pastry is here to help.
-
Identify
Pastry will identify flaky tests within your suite, organizing by failure rate and frequency, and will highlight whether the test outcomes are improving or worsening.
-
Triage
Tests can be flaky for a number of reasons. Pastry identifies trends in the types of failures so you can prioritize the most impactful fixes.
-
Resolve
Pastry encourages three stages of tests: standard, flaky, and quarantine. Once you've attempted a fix to a flaky test, promote it to quarantine to ensure the fix works so it can be promoted back to standard.