Continuous Testing Settings
You can access Continuous Testing settings on the Synthetic Monitoring & Testing Settings page.
By default, all your tests running in CI/CD pipelines run sequentially (one after the other). To change this behavior, set a parallelization value and save your selection.
Parallel tests are tests that run simultaneously in your continuous integration and continuous delivery (CI/CD) pipelines.
This ensures you can:
- Reduce pipeline duration and ship new features faster
- Increase development confidence and speed of delivery
- Have complete test coverage and reduce the volume of production-breaking bugs from reaching your codebase
Click Estimate Parallelization to see how many tests Datadog recommends running in parallel based on your Continuous Testing metrics.
After specifying the expected duration for testing in your CI pipeline and, optionally, the average number of tests per CI batch, the Estimated Parallelization section calculates the amount of parallelization you want to set:
- Under Set your preferences, select the Parallelization option.
- Customize the parallelization you need based on how many tests you want to run in parallel.
- Click Save Selection.
- Confirm your selection.
In order to customize the parallelization for Continuous Testing, you must have the billing_edit permission.
Otherwise, the following error displays: You're missing edit permission for Continuous Testing settings. You can run your tests with a parallelization of X (up to X tests running at the same time at a given point during your CI). To increase this value, reach out to your administrator admin.email@datadoghq.com.
For more information, see Datadog Role Permissions.
Additional helpful documentation, links, and articles:
