- 필수 기능
- 앱 내
- 서비스 관리
- 인프라스트럭처
- 애플리케이션 성능
- 디지털 경험
- 소프트웨어 제공
- 보안
- 로그 관리
- 관리
- 인프라스트럭처
- ci
- containers
- csm
- ndm
- otel_guides
- overview
- slos
- synthetics
- tests
- 워크플로
Intelligent Test Runner allows you to streamline your organization’s test impact analysis by intelligently excluding irrelevant tests that are not affected by recent code changes.
With Test Visibility, development teams can configure Intelligent Test Runner for their test services, set branches to exclude (such as the default branch), and define files to be tracked (which triggers full runs of all tests when any tracked file changes).
Configure and enable Intelligent Test Runner for your test services to reduce unnecessary testing time, enhance CI test efficiency, and reduce costs, while maintaining the reliability and performance across your CI environments.
Intelligent Test Runner uses code coverage data to determine whether or not tests should be skipped. For more information, see How Intelligent Test Runner Works in Datadog.
To set up the Intelligent Test Runner, see the following documentation for your programming language:
To enable the Intelligent Test Runner:
Intelligent Test Runner
column for a service.You must have the Intelligent Test Runner Activation Write
permission. For more information, see the Datadog Role Permissions documentation.
Disabling the Intelligent Test Runner on critical branches (such as your default branch) ensures comprehensive test coverage, whereas enabling it to run on feature or development branches helps maximize testing efficiency.
You can configure the Intelligent Test Runner to prevent specific tests from being skipped. These tests are known as unskippable tests, and are run regardless of code coverage data.
To configure the Intelligent Test Runner:
documentation/content/**
or domains/shopist/apps/api/BUILD.bazel
). Intelligent Test Runner runs all CI tests when any of these tracked files change.Once you’ve configured Intelligent Test Runner on a test service, execute a test suite run on your default branch. This establishes a baseline for the Intelligent Test Runner to accurately skip irrelevant tests in future commits.
Explore the data collected by enabling Intelligent Test Runner, such as the time savings achieved by skipping tests, as well as your organization’s usage of Intelligent Test Runner, to improve your CI efficiency.
You can create dashboards to visualize your testing metrics, or use an out-of-the-box dashboard containing widgets populated with data collected by the Intelligent Test Runner to help you identify areas of improvement with usage patterns and trends.
The Test Visibility Explorer allows you to create visualizations and filter test spans using the data collected from Test Visibility and the Intelligent Test Runner. When the Intelligent Test Runner is active, it displays the amount of time saved for each test session or commit. The duration bars turn purple to indicate active test skipping.
Navigate to Software Delivery > Test Visibility > Test Runs and select Session
to start filtering your test session span results.
Navigate to Software Delivery > Test Visibility > Test Runs and select Module
to start filtering your test module span results.
Navigate to Software Delivery > Test Visibility > Test Runs and select Suite
to start filtering your test suite span results.
Navigate to Software Delivery > Test Visibility > Test Runs and select Test
to start filtering your test span results.
Use the following out-of-the-box Intelligent Test Runner facets to customize the search query:
For example, to filter test session runs that have Test Skipping Enabled
, you can use @test.itr.tests_skipping.enabled:true
in the search query.
Then, click on a test session run and see the amount of time saved by the Intelligent Test Runner in the Test Session Details section on the test session side panel.
Additional helpful documentation, links, and articles: