Service Scorecards are in beta.

Datadog provides default rules so you can get started quickly with Service Scorecards, but you can also create custom rules.

Create custom rules

To add and evaluate custom rules using the Scorecards API:

  1. Specify the name of the rule, the scorecard it belongs to, a rule description, and an owner to pass to /scorecard/rules.
  2. Send an outcome of pass, fail, or skip for each {rule, service} tuple that you are evaluating to /scorecard/outcomes/batch.
  3. View an overview of outcomes and remarks in the Scorecards dashboard.

After initial setup, rules can also be enabled or disabled through the API.

To evaluate and add custom rules in the Scorecards UI:

  1. Click Create Rule on the Scorecards page.
  2. Specify the name of the rule, the scorecard it belongs to, a rule description, and the owning team.
  3. Navigate to the rule you created and select Edit Outcome next to the service that you want to evaluate.
  4. Select the relevant outcome of pass, fail, or skip and add an optional remark describing the reason for the outcome.
  5. View an overview of outcomes and remarks in the Scorecards dashboard.

Further reading

PREVIEWING: may/unit-testing