Microsoft Azure HDInsight
Overview
Azure HDInsight is a cloud service that makes it easy, fast, and cost-effective to process massive amounts of data.
Use the Datadog Azure integration to collect metrics from Azure HDInsight.
Setup
Installation
If you haven’t already, set up the Microsoft Azure integration first. There are no other installation steps.
Data Collected
Metrics
azure.hdinsight_clusters.categorized_gateway_requests
(count) | The number of gateway requests by categories: (1xx/2xx/3xx/4xx/5xx)
Shown as request |
azure.hdinsight_clusters.count
(gauge) | The count of Azure HDInsight clusters |
azure.hdinsight_clusters.gateway_requests
(count) | The number of gateway requests
Shown as request |
azure.hdinsight_clusters.kafka_rest_proxy.consumer_request.m1_delta
(count) | The number of consumer requests to kafka REST proxy |
azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_fail.m1_delta
(count) | Consumer request exceptions |
azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_time.p95
(gauge) | Message latency in a consumer request through kafka REST proxy
Shown as millisecond |
azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_waiting_in_queue_time.p95
(gauge) | Consumer REST proxy queue length
Shown as millisecond |
azure.hdinsight_clusters.kafka_rest_proxy.messages_in.m1_delta
(count) | The number of producer messages through kafka REST proxy |
azure.hdinsight_clusters.kafka_rest_proxy.messages_out.m1_delta
(count) | The number of consumer messages through kafka REST proxy |
azure.hdinsight_clusters.kafka_rest_proxy.open_connections
(count) | The number of concurrent connections through kafka REST proxy |
azure.hdinsight_clusters.kafka_rest_proxy.producer_request.m1_delta
(count) | The number of producer requests to kafka REST proxy |
azure.hdinsight_clusters.kafka_rest_proxy.producer_request_fail.m1_delta
(count) | The number of producer request exceptions |
azure.hdinsight_clusters.kafka_rest_proxy.producer_request_time.p95
(gauge) | Message latency in a producer request through kafka REST proxy
Shown as millisecond |
azure.hdinsight_clusters.kafka_rest_proxy.producer_request_waiting_in_queue_time.p95
(gauge) | Producer REST proxy queue length
Shown as millisecond |
azure.hdinsight_clusters.num_active_workers
(gauge) | The number of active workers |
azure.hdinsight_clusters.pending_cpu
(gauge) | Pending CPU requests in yarn |
azure.hdinsight_clusters.pending_memory
(gauge) | Pending memory requests in yarn |
azure.hdinsight_clusters.status
(gauge) | The status of Azure HDInsight clusters (deprecated) |
Events
The Azure HDInsight integration does not include any events.
Service Checks
The Azure HDInsight integration does not include any service checks.
Troubleshooting
Need help? Contact Datadog support.
