概要

Google Cloud Pub/Sub は、エンタープライズメッセージ指向ミドルウェアの拡張性、柔軟性、信頼性をクラウドにもたらします。

Google Pub/Sub からメトリクスを取得して、以下のことができます。

  • Pub/Sub のトピックおよびサブスクリプションのパフォーマンスを視覚化。
  • Pub/Sub のトピックおよびサブスクリプションのパフォーマンスをアプリケーションと関連付け。

セットアップ

メトリクスの収集

インストール

Google Cloud Platform インテグレーションをまだセットアップしていない場合は、最初にセットアップします。それ以上のインストール手順はありません。

構成

カスタム Pub/Sub ラベルをタグとして収集するには、Cloud Asset Inventory のアクセス権を有効にします。

収集データ

Google Cloud Pub/Sub のログは Google Cloud Logging で収集され、Cloud Pub/Sub トピックを通じて Dataflow ジョブに送信されます。まだの場合は、Datadog Dataflow テンプレートでロギングをセットアップしてください

これが完了したら、Google Cloud Pub/Sub のログを Google Cloud Logging から Pub/Sub トピックへエクスポートします。

  1. Google Cloud Logging のページに移動し、Google Cloud Pub/Sub のログを絞り込みます。

  2. シンクを作成し、シンクに適宜名前を付けます。

  3. 宛先として “Cloud Pub/Sub” を選択し、その目的で作成された Pub/Sub トピックを選択します。: Pub/Sub トピックは別のプロジェクトに配置できます。

    Google Cloud Pub/Sub ログを Pub Sub へエクスポート
  4. 作成をクリックし、確認メッセージが表示されるまで待ちます。

収集データ

メトリクス

gcp.pubsub.snapshot.backlog_bytes
(gauge)
Total byte size of the messages retained in a snapshot.
Shown as byte
gcp.pubsub.snapshot.backlog_bytes_by_region
(gauge)
Total byte size of the messages retained in a snapshot, broken down by Cloud region.
Shown as byte
gcp.pubsub.snapshot.config_updates_count
(count)
Cumulative count of configuration changes, grouped by operation type and result.
Shown as update
gcp.pubsub.snapshot.num_messages
(gauge)
Number of messages retained in a snapshot.
Shown as message
gcp.pubsub.snapshot.num_messages_by_region
(gauge)
Number of messages retained in a snapshot, broken down by Cloud region.
Shown as message
gcp.pubsub.snapshot.oldest_message_age
(gauge)
Age (in seconds) of the oldest message retained in a snapshot.
Shown as second
gcp.pubsub.snapshot.oldest_message_age_by_region
(gauge)
Age (in seconds) of the oldest message retained in a snapshot, broken down by Cloud region.
Shown as second
gcp.pubsub.subscription.ack_latencies.avg
(gauge)
Average of ack latencies.
Shown as millisecond
gcp.pubsub.subscription.ack_latencies.samplecount
(count)
Sample Count for ack latencies.
Shown as millisecond
gcp.pubsub.subscription.ack_latencies.sumsqdev
(gauge)
Sum of Squared Deviation for ack latencies.
Shown as millisecond
gcp.pubsub.subscription.ack_message_count
(count)
Cumulative count of messages acknowledged by Acknowledge requests, grouped by delivery type.
Shown as byte
gcp.pubsub.subscription.backlog_bytes
(gauge)
Approximate size of the message backlog in a subscription.
Shown as byte
gcp.pubsub.subscription.byte_cost
(count)
Cost of operations per subscription measured.
Shown as byte
gcp.pubsub.subscription.config_updates_count
(count)
Number of configuration changes for subscriptions.
Shown as occurrence
gcp.pubsub.subscription.dead_letter_message_count
(count)
Cumulative count of messages published to dead letter topic.
Shown as message
gcp.pubsub.subscription.delivery_latency_health_score
(gauge)
A score that measures the health of a subscription.
Shown as occurrence
gcp.pubsub.subscription.exactly_once_warning_count
(count)
Count of instances (acks and modacks that may have failed) that may lead to message redeliveries.
Shown as occurrence
gcp.pubsub.subscription.expired_ack_deadlines_count
(count)
Cumulative count of messages whose ack deadline expired while the messages was outstanding to a subscriber client.
Shown as message
gcp.pubsub.subscription.mod_ack_deadline_message_count
(count)
Cumulative count of messages whose deadline was updated by ModifyAckDeadline requests.
Shown as message
gcp.pubsub.subscription.mod_ack_deadline_message_operation_count
(count)
Number of ModifyAckDeadline operations.
Shown as operation
gcp.pubsub.subscription.mod_ack_deadline_request_count
(count)
Number of ModifyAckDeadline requests.
Shown as request
gcp.pubsub.subscription.num_outstanding_messages
(gauge)
Messages delivered but not yet acknowledged.
Shown as message
gcp.pubsub.subscription.num_retained_acked_messages
(gauge)
Number of acknowledged messages retained in a subscription.
Shown as message
gcp.pubsub.subscription.num_retained_acked_messages_by_region
(gauge)
Number of acknowledged messages retained in a subscription, broken down by Cloud region.
Shown as message
gcp.pubsub.subscription.num_unacked_messages_by_region
(gauge)
Number of unacknowledged messages in a subscription, broken down by Cloud region.
Shown as message
gcp.pubsub.subscription.num_undelivered_messages
(gauge)
Messages pending to be delivered.
Shown as message
gcp.pubsub.subscription.oldest_retained_acked_message_age
(gauge)
Age (in seconds) of the oldest acknowledged message retained in a subscription.
Shown as second
gcp.pubsub.subscription.oldest_retained_acked_message_age_by_region
(gauge)
Age (in seconds) of the oldest acknowledged message retained in a subscription, broken down by Cloud region.
Shown as second
gcp.pubsub.subscription.oldest_unacked_message_age
(gauge)
Age of the oldest unacknowledged message in a subscription.
Shown as second
gcp.pubsub.subscription.oldest_unacked_message_age_by_region
(gauge)
Age (in seconds) of the oldest unacknowledged message in a subscription, broken down by Cloud region.
Shown as second
gcp.pubsub.subscription.pull_ack_message_operation_count
(count)
Number of acknowledge message operations.
Shown as operation
gcp.pubsub.subscription.pull_ack_request_count
(count)
Delta count of message pull acknowledgement requests.
Shown as request
gcp.pubsub.subscription.pull_message_operation_count
(count)
Number of pull message operations.
Shown as operation
gcp.pubsub.subscription.pull_request_count
(count)
Number of message pull requests.
Shown as request
gcp.pubsub.subscription.push_request_count
(count)
Number of message push attempts.
Shown as request
gcp.pubsub.subscription.push_request_latencies.avg
(gauge)
Average of push request latencies.
Shown as microsecond
gcp.pubsub.subscription.push_request_latencies.samplecount
(count)
Sample Count for push request latencies.
Shown as microsecond
gcp.pubsub.subscription.push_request_latencies.sumsqdev
(gauge)
Sum of Squared Deviation for push request latencies.
Shown as microsecond
gcp.pubsub.subscription.retained_acked_bytes
(gauge)
Total byte size of the acknowledged messages retained in a subscription.
Shown as byte
gcp.pubsub.subscription.retained_acked_bytes_by_region
(gauge)
Total byte size of the acknowledged messages retained in a subscription, broken down by Cloud region.
Shown as byte
gcp.pubsub.subscription.seek_request_count
(count)
Cumulative count of seek attempts, grouped by result.
Shown as request
gcp.pubsub.subscription.sent_message_count
(count)
Cumulative count of messages sent by Cloud Pub/Sub to subscriber clients.
Shown as message
gcp.pubsub.subscription.streaming_pull_ack_message_operation_count
(count)
Cumulative count of StreamingPull acknowledge message operations, grouped by result.
Shown as operation
gcp.pubsub.subscription.streaming_pull_ack_request_count
(count)
Cumulative count of streaming pull requests with non-empty acknowledge ids, grouped by result.
Shown as request
gcp.pubsub.subscription.streaming_pull_message_operation_count
(count)
Cumulative count of streaming pull message operations, grouped by result.
Shown as operation
gcp.pubsub.subscription.streaming_pull_mod_ack_deadline_message_operation_count
(count)
Cumulative count of StreamingPull ModifyAckDeadline operations, grouped by result.
Shown as operation
gcp.pubsub.subscription.streaming_pull_mod_ack_deadline_request_count
(count)
Cumulative count of streaming pull requests with non-empty ModifyAckDeadline fields, grouped by result.
Shown as request
gcp.pubsub.subscription.streaming_pull_response_count
(count)
Cumulative count of streaming pull responses, grouped by result.
Shown as response
gcp.pubsub.subscription.unacked_bytes_by_region
(gauge)
Total byte size of the unacknowledged messages in a subscription, broken down by Cloud region.
Shown as byte
gcp.pubsub.topic.byte_cost
(count)
Byte cost of operations per topic.
Shown as byte
gcp.pubsub.topic.config_updates_count
(count)
Number of configuration changes for topics.
Shown as occurrence
gcp.pubsub.topic.message_sizes.avg
(gauge)
Average of publish message sizes.
Shown as byte
gcp.pubsub.topic.message_sizes.samplecount
(count)
Sample Count for publish message sizes.
Shown as byte
gcp.pubsub.topic.message_sizes.sumsqdev
(gauge)
Sum of Squared Deviation for publish message sizes.
Shown as byte
gcp.pubsub.topic.num_retained_acked_messages_by_region
(gauge)
Number of acknowledged messages retained in a topic, broken down by Cloud region.
Shown as message
gcp.pubsub.topic.num_retained_messages
(gauge)
Number of messages retained in a topic.
Shown as message
gcp.pubsub.topic.num_unacked_messages_by_region
(gauge)
Number of unacknowledged messages in a topic, broken down by Cloud region.
Shown as message
gcp.pubsub.topic.oldest_retained_acked_message_age_by_region
(gauge)
Age (in seconds) of the oldest acknowledged message retained in a topic, broken down by Cloud region.
Shown as second
gcp.pubsub.topic.oldest_retained_message_age
(gauge)
Age (in seconds) of the oldest message retained in a topic.
Shown as second
gcp.pubsub.topic.oldest_unacked_message_age_by_region
(gauge)
Age (in seconds) of the oldest unacknowledged message in a topic, broken down by Cloud region.
Shown as second
gcp.pubsub.topic.retained_acked_bytes_by_region
(gauge)
Total byte size of the acknowledged messages retained in a topic, broken down by Cloud region.
Shown as byte
gcp.pubsub.topic.retained_bytes
(gauge)
Total byte size of the messages retained in a topic.
Shown as byte
gcp.pubsub.topic.send_message_operation_count
(count)
Number of publish message operations.
Shown as operation
gcp.pubsub.topic.send_request_count
(count)
Number of message send requests.
Shown as request
gcp.pubsub.topic.send_request_latencies.avg
(gauge)
Average of topic send request latencies.
Shown as microsecond
gcp.pubsub.topic.send_request_latencies.samplecount
(count)
Sample Count for topic send request latencies.
Shown as microsecond
gcp.pubsub.topic.send_request_latencies.sumsqdev
(gauge)
Sum of Squared Deviation for topic send request latencies.
Shown as microsecond
gcp.pubsub.topic.unacked_bytes_by_region
(gauge)
Total byte size of the unacknowledged messages in a topic, broken down by Cloud region.
Shown as byte

イベント

Google Cloud Pub/Sub インテグレーションには、イベントは含まれません。

サービスチェック

Google Cloud Pub/Sub インテグレーションには、サービスのチェック機能は含まれません。

トラブルシューティング

ご不明な点は、Datadog のサポートチームまでお問い合わせください。

PREVIEWING: alai97/reorganize-some-sections-in-dora-metrics