Overview
Google Cloud Storage is unified object storage for developers and enterprises, from live data serving to data analytics/ML to data archiving.
Get metrics from Google Storage to:
- Visualize the performance of your Storage services.
- Correlate the performance of your Storage services with your applications.
Setup
Installation
If you haven’t already, set up the Google Cloud Platform integration first. There are no other installation steps.
Configuration
To collect custom Cloud Storage labels as tags, enable the cloud asset inventory permission.
Log collection
Google Cloud Storage logs are collected with Google Cloud Logging and sent to a Dataflow job through a Cloud Pub/Sub topic. If you haven’t already, set up logging with the Datadog Dataflow template.
Once this is done, export your Google Cloud Storage logs from Google Cloud Logging to the Pub/Sub topic:
- Go to the Google Cloud Logging page and filter the Google Cloud Storage logs.
- Click Create Export and name the sink.
- Choose “Cloud Pub/Sub” as the destination and select the Pub/Sub topic that was created for that purpose. Note: The Pub/Sub topic can be located in a different project.
- Click Create and wait for the confirmation message to show up.
Data Collected
Metrics
gcp.storage.api.request_count
(count) | The number of API calls
Shown as request |
gcp.storage.authn.authentication_count
(count) | The number of HMAC/RSA signed requests
Shown as request |
gcp.storage.authz.acl_based_object_access_count
(count) | The number of requests that result in an object being granted access solely due to object ACLs.
Shown as request |
gcp.storage.authz.acl_operations_count
(count) | The usage of ACL operations
Shown as operation |
gcp.storage.authz.object_specific_acl_mutation_count
(count) | The number of changes made to object specific ACLs |
gcp.storage.network.received_bytes_count
(count) | The number of bytes received over the network
Shown as byte |
gcp.storage.network.sent_bytes_count
(count) | The number of bytes sent over the network
Shown as byte |
gcp.storage.storage.object_count
(gauge) | The total number of objects per bucket
Shown as object |
gcp.storage.storage.total_byte_seconds
(gauge) | The total daily storage in byte seconds used
Shown as second |
gcp.storage.storage.total_bytes
(gauge) | The total size of all objects in the bucket
Shown as byte |
Events
The Google Cloud Storage integration does not include any events.
Service Checks
The Google Cloud Storage integration does not include any service checks.
Troubleshooting
Need help? Contact Datadog support.
