FlakeFence

FlakeFence is a web app (with a lightweight CI agent) that detects, quarantines, and explains flaky unit tests across your repos. It ingests CI results, reruns suspect tests under controlled variations (seed, timing, parallelism, CPU throttling), and assigns a flakiness score with likely root causes (race conditions, timeouts, shared state, order dependence). Instead of spamming teams with noise, it auto-creates a single actionable ticket per flaky cluster, links to failing logs, and suggests minimal reproduction steps. It also supports “quarantine mode” that prevents flaky tests from blocking merges while still tracking regressions, so teams can keep shipping without ignoring quality. This is a combination traditional + AI app: traditional for deterministic reruns/scoring, AI for log clustering, root-cause hints, and ticket summaries. Brutal truth: if you can’t integrate cleanly with GitHub Actions/Jenkins/GitLab CI and show value in week one, teams won’t keep paying.

← Back to idea list