Google Cloud Load Balancing

Overview

Google Cloud Load Balancing gives you the ability to distribute load-balanced compute resources in single or multiple regions, to meet your high availability requirements, to put your resources behind a single anycast IP and to scale your resources up or down with intelligent Autoscaling.

Use the Datadog Google Cloud Platform integration to collect metrics from Google Cloud Load Balancing.

Setup

Metric collection

Installation

If you haven’t already, set up the Google Cloud Platform integration first. There are no other installation steps.

Log collection

Google Cloud HTTP Loadbalancer logs are collected with Google Cloud Logging and sent to a Dataflow job through a Cloud Pub/Sub topic. If you haven’t already, set up logging with the Datadog Dataflow template.

Once this is done, export your Google Cloud HTTP Loadbalancer logs from Google Cloud Logging to the Pub/Sub topic:

  1. Go to the Google Cloud Logging page and filter the Google Cloud HTTP Loadbalancer logs.
  2. Click Create Sink and name the sink accordingly.
  3. Choose “Cloud Pub/Sub” as the destination and select the Pub/Sub topic that was created for that purpose. Note: The Pub/Sub topic can be located in a different project.
  4. Click Create and wait for the confirmation message to show up.

Data Collected

Metrics

gcp.loadbalancing.https.backend_latencies.avg
(gauge)
Average latency of request sent by the proxy to backend until proxy receives last byte of response from backend.
Shown as millisecond
gcp.loadbalancing.https.backend_latencies.p95
(gauge)
95th percentile of latency of request sent by the proxy to backend until proxy receives last byte of response from backend.
Shown as millisecond
gcp.loadbalancing.https.backend_latencies.p99
(gauge)
99th percentile of latency of request sent by the proxy to backend until proxy receives last byte of response from backend.
Shown as millisecond
gcp.loadbalancing.https.backend_latencies.samplecount
(count)
Sample count of latency of request sent by the proxy to backend until proxy receives last byte of response from backend.
Shown as sample
gcp.loadbalancing.https.backend_latencies.sumsqdev
(gauge)
Sum of squared deviation for latency of request sent by the proxy to backend until proxy receives last byte of response from backend.
Shown as millisecond
gcp.loadbalancing.https.backend_request_bytes_count
(count)
The number of bytes sent as requests from external HTTP/S load balancer to backends.
Shown as byte
gcp.loadbalancing.https.backend_request_count
(count)
The number of requests served by backends of HTTP/S load balancer.
Shown as request
gcp.loadbalancing.https.backend_response_bytes_count
(count)
The number of bytes sent as responses from backends (or cache) to HTTP/S load balancer.
Shown as byte
gcp.loadbalancing.https.frontend_tcp_rtt.avg
(gauge)
Average RTT for each connection between client and proxy.
Shown as millisecond
gcp.loadbalancing.https.frontend_tcp_rtt.p95
(gauge)
95th percentile of RTT for each connection between client and proxy.
Shown as millisecond
gcp.loadbalancing.https.frontend_tcp_rtt.p99
(gauge)
99th percentile RTT for each connection between client and proxy.
Shown as millisecond
gcp.loadbalancing.https.frontend_tcp_rtt.samplecount
(count)
Sample count of RTT for each connection between client and proxy.
Shown as sample
gcp.loadbalancing.https.frontend_tcp_rtt.sumsqdev
(gauge)
Sum of squared deviation of RTT for each connection between client and proxy.
Shown as millisecond
gcp.loadbalancing.https.internal.backend_latencies.avg
(gauge)
Average of latency calculated from request sent by proxy to the backend until proxy received last byte of response from backend.
Shown as millisecond
gcp.loadbalancing.https.internal.backend_latencies.p95
(gauge)
95th percentile of latency calculated from request sent by proxy to the backend until proxy received last byte of response from backend.
Shown as millisecond
gcp.loadbalancing.https.internal.backend_latencies.p99
(gauge)
99th percentile of latency calculated from request sent by proxy to the backend until proxy received last byte of response from backend.
Shown as millisecond
gcp.loadbalancing.https.internal.backend_latencies.samplecount
(count)
Sample count of latency calculated from request sent by proxy to the backend until proxy received last byte of response from backend.
Shown as sample
gcp.loadbalancing.https.internal.backend_latencies.sumsqdev
(gauge)
Sum of squared deviation of latency calculated from request sent by proxy to the backend until proxy received last byte of response from backend.
Shown as millisecond
gcp.loadbalancing.https.internal.request_bytes_count
(count)
The number of bytes sent as requests from clients to HTTP/S load balancer.
Shown as byte
gcp.loadbalancing.https.internal.request_count
(count)
The number of requests served by HTTP/S load balancer.
Shown as request
gcp.loadbalancing.https.internal.response_bytes_count
(count)
The number of bytes sent as responses from HTTP/S load balancer to clients.
Shown as byte
gcp.loadbalancing.https.internal.total_latencies.avg
(gauge)
Average of the latency calculated from when request received by proxy until the proxy sees ACK from client on last response byte.
Shown as millisecond
gcp.loadbalancing.https.internal.total_latencies.p95
(gauge)
95th percentile of the latency calculated from when request received by proxy until the proxy sees ACK from client on last response byte.
Shown as millisecond
gcp.loadbalancing.https.internal.total_latencies.p99
(gauge)
99th percentile of the latency calculated from when request received by proxy until the proxy sees ACK from client on last response byte.
Shown as millisecond
gcp.loadbalancing.https.internal.total_latencies.samplecount
(count)
Sample count of the latency calculated from when request received by proxy until the proxy sees ACK from client on last response byte.
Shown as sample
gcp.loadbalancing.https.internal.total_latencies.sumsqdev
(gauge)
Sum of squared deviation of the latency calculated from when request received by proxy until the proxy sees ACK from client on last response byte.
Shown as millisecond
gcp.loadbalancing.https.request_bytes_count
(count)
Bytes sent as requests from clients to L7 load balancer.
Shown as byte
gcp.loadbalancing.https.request_count
(count)
Number of requests served by L7 load balancer.
Shown as request
gcp.loadbalancing.https.response_bytes_count
(count)
Bytes sent as responses from L7 load balancer to clients.
Shown as byte
gcp.loadbalancing.https.total_latencies.avg
(gauge)
Average latency calculated from request received by proxy until proxy sees ACK from client on last response byte.
Shown as millisecond
gcp.loadbalancing.https.total_latencies.p95
(gauge)
95th percentile of latency calculated from request received by proxy until proxy sees ACK from client on last response byte.
Shown as millisecond
gcp.loadbalancing.https.total_latencies.p99
(gauge)
99th percentile of latency calculated from request received by proxy until proxy sees ACK from client on last response byte.
Shown as millisecond
gcp.loadbalancing.https.total_latencies.samplecount
(count)
Sample count of latency calculated from request received by proxy until proxy sees ACK from client on last response byte.
Shown as sample
gcp.loadbalancing.https.total_latencies.sumsqdev
(gauge)
Sum of squared deviation of latency calculated from request received by proxy until proxy sees ACK from client on last response byte.
Shown as millisecond
gcp.loadbalancing.l3.external.egress_bytes_count
(count)
The number of bytes sent from NetLB backend to client of the flow. For TCP flows it's counting bytes on application stream only.
Shown as byte
gcp.loadbalancing.l3.external.egress_packets_count
(count)
The number of packets sent from NetLB backend to client of the flow.
Shown as packet
gcp.loadbalancing.l3.external.ingress_bytes_count
(count)
The number of bytes sent from client to NetLB backend. For TCP flows it's counting bytes on application stream only.
Shown as byte
gcp.loadbalancing.l3.external.ingress_packets_count
(count)
The number of packets sent from client to NetLB backend.
Shown as packet
gcp.loadbalancing.l3.external.rtt_latencies.avg
(gauge)
Average RTT measured over TCP connections for NetLB flows.
Shown as millisecond
gcp.loadbalancing.l3.external.rtt_latencies.p95
(gauge)
95th percentile of RTT measured over TCP connections for NetLB flows.
Shown as millisecond
gcp.loadbalancing.l3.external.rtt_latencies.p99
(gauge)
99th percentile of RTT measured over TCP connections for NetLB flows.
Shown as millisecond
gcp.loadbalancing.l3.external.rtt_latencies.samplecount
(count)
Sample count of RTT measured over TCP connections for NetLB flows.
Shown as sample
gcp.loadbalancing.l3.external.rtt_latencies.sumsqdev
(gauge)
Sum of squared deviation for RTT measured over TCP connections for NetLB flows.
Shown as millisecond
gcp.loadbalancing.l3.internal.egress_bytes_count
(count)
The number of bytes sent from ILB backend to client (for TCP flows it's counting bytes on application stream only).
Shown as byte
gcp.loadbalancing.l3.internal.egress_packets_count
(count)
The number of packets sent from ILB backend to client of the flow.
Shown as packet
gcp.loadbalancing.l3.internal.ingress_bytes_count
(count)
The number of bytes sent from client to ILB backend (for TCP flows it's counting bytes on application stream only).
Shown as byte
gcp.loadbalancing.l3.internal.ingress_packets_count
(count)
The number of packets sent from client to ILB backend.
Shown as packet
gcp.loadbalancing.l3.internal.rtt_latencies.avg
(gauge)
Average RTT measured over TCP connections for ILB flows.
Shown as millisecond
gcp.loadbalancing.l3.internal.rtt_latencies.p95
(gauge)
95th percentile of RTT measured over TCP connections for ILB flows.
Shown as millisecond
gcp.loadbalancing.l3.internal.rtt_latencies.p99
(gauge)
99th percentile of RTT measured over TCP connections for ILB flows.
Shown as millisecond
gcp.loadbalancing.l3.internal.rtt_latencies.samplecount
(count)
Sample count for RTT latencies
Shown as sample
gcp.loadbalancing.l3.internal.rtt_latencies.sumsqdev
(gauge)
Sum of squared deviation for RTT latencies
Shown as millisecond
gcp.loadbalancing.tcp_ssl_proxy.closed_connections
(count)
Number of connections that were terminated over TCP/SSL proxy.
Shown as connection
gcp.loadbalancing.tcp_ssl_proxy.egress_bytes_count
(count)
Number of bytes sent from VM to client using proxy.
Shown as byte
gcp.loadbalancing.tcp_ssl_proxy.frontend_tcp_rtt.avg
(gauge)
Average smoothed RTT measured by the proxy's TCP stack. Each minute application layer bytes pass from proxy to client.
Shown as millisecond
gcp.loadbalancing.tcp_ssl_proxy.frontend_tcp_rtt.p95
(gauge)
95th percentile of smoothed RTT measured by the proxy's TCP stack. Each minute application layer bytes pass from proxy to client.
Shown as millisecond
gcp.loadbalancing.tcp_ssl_proxy.frontend_tcp_rtt.p99
(gauge)
99th percentile of smoothed RTT measured by the proxy's TCP stack. Each minute application layer bytes pass from proxy to client.
Shown as millisecond
gcp.loadbalancing.tcp_ssl_proxy.frontend_tcp_rtt.samplecount
(count)
Sample count of smoothed RTT measured by the proxy's TCP stack. Each minute application layer bytes pass from proxy to client.
Shown as sample
gcp.loadbalancing.tcp_ssl_proxy.frontend_tcp_rtt.sumsqdev
(gauge)
Sum of squared deviation of smoothed RTT measured by the proxy's TCP stack. Each minute application layer bytes pass from proxy to client.
Shown as millisecond
gcp.loadbalancing.tcp_ssl_proxy.ingress_bytes_count
(count)
Number of bytes sent from client to VM using proxy.
Shown as byte
gcp.loadbalancing.tcp_ssl_proxy.new_connections
(count)
Number of connections that were created over TCP/SSL proxy.
Shown as connection
gcp.loadbalancing.tcp_ssl_proxy.open_connections
(count)
Current number of outstanding connections through the TCP/SSL proxy.
Shown as connection

Events

The Google Cloud Load Balancing integration does not include any events.

Service Checks

The Google Cloud Load Balancing integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.

PREVIEWING: rtrieu/product-analytics-ui-changes