- 필수 기능
- 시작하기
- Glossary
- 표준 속성
- Guides
- Agent
- 통합
- 개방형텔레메트리
- 개발자
- Administrator's Guide
- API
- Datadog Mobile App
- CoScreen
- Cloudcraft
- 앱 내
- 서비스 관리
- 인프라스트럭처
- 애플리케이션 성능
- APM
- Continuous Profiler
- 스팬 시각화
- 데이터 스트림 모니터링
- 데이터 작업 모니터링
- 디지털 경험
- 소프트웨어 제공
- 보안
- AI Observability
- 로그 관리
- 관리
",t};e.buildCustomizationMenuUi=t;function n(e){let t='
",t}function s(e){let n=e.filter.currentValue||e.filter.defaultValue,t='${e.filter.label}
`,e.filter.options.forEach(s=>{let o=s.id===n;t+=``}),t+="${e.filter.label}
`,t+=`Flaky Test Management is in Preview. Complete the form to request access.
Request AccessThe Flaky Test Management page provides a centralized view to track, triage, and remediate flaky tests across your organization. You can view every test’s status along with key impact metrics like number of pipeline failures, CI time wasted, and failure rate.
From this UI, you can act on flaky tests to mitigate their impact. Quarantine or disable problematic tests to keep known flakes from breaking builds, and create cases and Jira issues to track work toward fixes.
Use the status drop-down to change how a flaky test is handled in your CI pipeline. This can help reduce CI noise while retaining traceability and control. Available statuses are:
Status | Description |
---|---|
Active | The test is known to be flaky and is running in CI. |
Quarantined | Keep the test running in the background, but failures don’t affect CI status or break pipelines. This is useful for isolating flaky tests without blocking merges. |
Disabled | Skip the test entirely in CI. Use this when a test is no longer relevant or needs to be temporarily removed from the pipeline. |
Fixed | The test has passed consistently and is no longer flaky. If supported, use the remediation flow to confirm a fix and automatically apply this status, instead of manually changing it. |
Track the evolution of the number of flaky tests with the test_optimization.test_management.flaky_tests
out-of-the-box metric. The metric is enriched with the tags below to help you investigate the counts in more detail.
repository_id
branch
flaky_status
test_codeowners
The branch
tag only exists when the test has flaked in the default branch of the repository during the last 30 days. This helps you discard flaky tests that have only exhibited flakiness in feature branches, as these may not be relevant. You can configure the default branch of your repositories under Repository Settings.
For more information about a specific flaky test, use these options in the actions menu at the end of each row:
For any flaky test, you can create a case and use Case Management to track any work toward remediation. Click the Create Case button or use the actions menu at the end of the row.
When you fix a flaky test, Test Optimization’s remediation flow can confirm the fix by retrying the test multiple times. If successful, the test’s status is automatically updated to Fixed
. To enable the remediation flow:
DD_ABC123
).git commit -m "DD_ABC123"
).Disabled
.Fixed
.Active
, Quarantined
, or Disabled
).To use Flaky Test Management features, you must use Datadog’s native instrumentation for your test framework. The table below outlines the minimum versions of each Datadog tracing library required to quarantine, disable, and attempt to fix flaky tests. Click a language name for setup information:
Language | Quarantine & Disable | Attempt to fix |
---|---|---|
.NET | 3.13.0+ | 3.17.0+ |
Go | 1.73.0+ | Not available |
Java | 1.48.0+ | 1.50.0+ |
JavaScript | 5.44.0+ | 5.52.0+ |
Python | 3.3.0+ | 3.8.0+ |
Ruby | 1.13.0+ | 1.17.0+ |