Microsoft Azure Synapse

Overview

Azure Synapse Analytics is an analytics service that brings together data integration, enterprise data warehousing and big data analytics.

Use the Datadog Azure integration to collect metrics from Azure Synapse.

Setup

Installation

If you haven’t already, set up the Microsoft Azure integration first. There are no other installation steps.

Data Collected

Metrics

azure.synapse_workspaces.builtin_sql_pool_data_processed_bytes
(count)
Amount of data processed by queries.
Shown as byte
azure.synapse_workspaces.builtin_sql_pool_login_attempts
(count)
Count of login attempts that succeded or failed.
azure.synapse_workspaces.builtin_sql_pool_requests_ended
(count)
Count of requests that succeeded, failed, or were cancelled.
azure.synapse_workspaces.integration_activity_runs_ended
(count)
Count of integration activities that succeeded, failed or were cancelled.
azure.synapse_workspaces.integration_link_connection_events
(count)
Number of Synapse Link connection events including start, stop and failure.
azure.synapse_workspaces.integration_link_processed_changed_rows
(count)
Changed row count processed by Synapse Link.
azure.synapse_workspaces.integration_link_processed_data_volume
(count)
Data volume in bytes processed by Synapse Link.
Shown as byte
azure.synapse_workspaces.integration_link_processing_latency_in_seconds
(gauge)
Synapse Link data processing latency in seconds.
azure.synapse_workspaces.integration_link_table_events
(count)
Number of Synapse Link table events including snapshot, removal and failure.
azure.synapse_workspaces.integration_pipeline_runs_ended
(count)
Count of integration pipeline runs that succeeded, failed or were cancelled.
azure.synapse_workspaces.integration_trigger_runs_ended
(count)
Count of integration triggers that succeeded, failed or were cancelled.
azure.synapse_workspaces.sql_streaming_backlogged_input_event_sources
(count)
This is a preview metric available in East US,West Europe. Number of input events sources backlogged.
azure.synapse_workspaces.sql_streaming_conversion_errors
(count)
This is a preview metric available in East US, West Europe. Number of output events that could not be converted to the expected output schema. Error policy can be changed to drop events that encounter this scenario.
azure.synapse_workspaces.sql_streaming_deserialization_error
(count)
This is a preview metric available in East US, West Europe. Number of input events that could not be deserialized.
azure.synapse_workspaces.sql_streaming_early_input_events
(count)
This is a preview metric available in East US, West Europe. Number of input events which application time is considered early compared to arrival time, according to early arrival policy.
azure.synapse_workspaces.sql_streaming_input_event_bytes
(count)
This is a preview metric available in East US, West Europe. Amount of data received by the streaming job, in bytes. This can be used to validate that events are being sent to the input source.
azure.synapse_workspaces.sql_streaming_input_events
(count)
This is a preview metric available in East US, West Europe. Number of input events.
azure.synapse_workspaces.sql_streaming_input_events_sources_per_second
(count)
This is a preview metric available in East US, West Europe. Number of input events sources per second.
azure.synapse_workspaces.sql_streaming_late_input_events
(count)
This is a preview metric available in East US, West Europe. Number of input events which application time is considered late compared to arrival time, according to late arrival policy.
azure.synapse_workspaces.sql_streaming_out_of_order_events
(count)
This is a preview metric available in East US, West Europe. Number of Event Hub Events (serialized messages) received by the Event Hub input adapter, received out of order that were either dropped or given an adjusted timestamp, based on the event ordering policy.
azure.synapse_workspaces.sql_streaming_output_events
(count)
This is a preview metric available in East US, West Europe. Number of output events.
azure.synapse_workspaces.sql_streaming_output_watermark_delay_seconds
(gauge)
This is a preview metric available in East US, West Europe. Output watermark delay in seconds.
azure.synapse_workspaces.sql_streaming_resource_utilization
(gauge)
This is a preview metric available in East US, West Europe.
Shown as percent
azure.synapse_workspaces.sql_streaming_runtime_errors
(count)
This is a preview metric available in East US, West Europe. Total number of errors related to query processing (excluding errors found while ingesting events or outputting results).
azure.synapse_workspaces.count
(gauge)
Count of Synapse workspaces.
azure.synapse_workspaces.status
(gauge)
Status of Synapse workspaces(deprecated).
azure.synapse_workspaces_bigdatapools.big_data_pool_allocated_cores
(gauge)
Allocated vCores for an Apache Spark Pool.
azure.synapse_workspaces_bigdatapools.big_data_pool_allocated_memory
(gauge)
Allocated Memory for Apache Spark pool (GB).
azure.synapse_workspaces_bigdatapools.big_data_pool_applications_active
(gauge)
Total Active Apache Spark pool Applications.
azure.synapse_workspaces_bigdatapools.big_data_pool_applications_ended
(count)
Count of Apache Spark pool applications ended.
azure.synapse_workspaces_bigdatapools.count
(gauge)
Count of Synapse workspaces bigDataPools.
azure.synapse_workspaces_bigdatapools.status
(gauge)
Status of Synapse workspaces bigDataPools(deprecated).
azure.synapse_workspaces_scopepools.scope_pool_job_pn_metric
(gauge)
PN (process node) duration (Milliseconds) used by each SCOPE job.
Shown as millisecond
azure.synapse_workspaces_scopepools.scope_pool_job_queued_duration_metric
(gauge)
Queued duration (Milliseconds) used by each SCOPE job.
Shown as millisecond
azure.synapse_workspaces_scopepools.scope_pool_job_running_duration_metric
(gauge)
Running duration (Milliseconds) used by each SCOPE job.
Shown as millisecond
azure.synapse_workspaces_scopepools.count
(gauge)
Count of Synapse workspaces scopePools.
azure.synapse_workspaces_scopepools.status
(gauge)
Status of Synapse workspaces scopePools(deprecated).
azure.synapse_workspaces_sqlpools.active_queries
(count)
Active queries. Using this metric unfiltered and unsplit displays all active queries running on the system.
azure.synapse_workspaces_sqlpools.adaptive_cache_hit_percent
(gauge)
Measures how well workloads are utilizing the adaptive cache. Use this metric with the cache hit percentage metric to determine whether to scale for additional capacity or rerun workloads to hydrate the cache.
Shown as percent
azure.synapse_workspaces_sqlpools.adaptive_cache_used_percent
(gauge)
Measures how well workloads are utilizing the adaptive cache. Use this metric with the cache used percentage metric to determine whether to scale for additional capacity or rerun workloads to hydrate the cache.
Shown as percent
azure.synapse_workspaces_sqlpools.connections
(count)
Count of total logins to the SQL pool.
azure.synapse_workspaces_sqlpools.connections_blocked_by_firewall
(count)
Count of connections blocked by firewall rules. Revisit access control policies for your SQL pool and monitor these connections if the count is high.
azure.synapse_workspaces_sqlpools.cpu_percent
(gauge)
CPU utilization across all nodes in the SQL pool.
Shown as percent
azure.synapse_workspaces_sqlpools.dwu_limit
(gauge)
Service level objective of the SQL pool.
azure.synapse_workspaces_sqlpools.dwu_used
(gauge)
Represents a high-level representation of usage across the SQL pool. Measured by DWU limit * DWU percentage.
azure.synapse_workspaces_sqlpools.dwu_used_percent
(gauge)
Represents a high-level representation of usage across the SQL pool. Measured by taking the maximum between CPU percentage and data input/output percentage.
Shown as percent
azure.synapse_workspaces_sqlpools.local_temp_db_used_percent
(gauge)
Local tempdb utilization across all compute nodes - values are emitted every five minute.
Shown as percent
azure.synapse_workspaces_sqlpools.memory_used_percent
(gauge)
Memory utilization across all nodes in the SQL pool.
Shown as percent
azure.synapse_workspaces_sqlpools.queued_queries
(count)
Cumulative count of requests queued after the max concurrency limit was reached.
azure.synapse_workspaces_sqlpools.wlg_active_queries
(count)
Active queries within the workload group. Using this metric unfiltered and unsplit displays all active queries running on the system.
azure.synapse_workspaces_sqlpools.wlg_active_queries_timeouts
(count)
Queries for the workload group that have timed out. Query timeouts reported by this metric are only once the query has started executing (it does not include wait time due to locking or resource waits).
azure.synapse_workspaces_sqlpools.wlg_allocation_by_effective_cap_resource_percent
(gauge)
Displays the percentage allocation of resources relative to the effective cap resource percent per workload group. This metric provides the effective utilization of the workload group.
Shown as percent
azure.synapse_workspaces_sqlpools.wlg_allocation_by_system_percent
(gauge)
Percentage allocation of resources relative to the entire system.
Shown as percent
azure.synapse_workspaces_sqlpools.wlg_effective_cap_resource_percent
(gauge)
Effective cap resource percent for the workload group. If there are other workload groups with minpercentageresource greater than 0, the effectivecappercentage_resource is lowered proportionally.
Shown as percent
azure.synapse_workspaces_sqlpools.wlg_effective_min_resource_percent
(gauge)
Effective min resource percentage setting allowed considering the service level and the workload group settings. The effective minpercentageresource can be adjusted higher on lower service levels.
Shown as percent
azure.synapse_workspaces_sqlpools.wlg_queued_queries
(count)
Cumulative count of requests queued after the max concurrency limit was reached.
azure.synapse_workspaces_sqlpools.count
(gauge)
Count of Synapse workspaces sqlPools.
azure.synapse_workspaces_sqlpools.status
(gauge)
Status of Synapse workspaces sqlPools(deprecated).

Events

The Azure Synapse integration does not include any events.

Service Checks

The Azure Synapse integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.

PREVIEWING: alai97/reorganize-some-sections-in-dora-metrics