This page is not yet available in Spanish. We are working on its translation. If you have any questions or feedback about our current translation project, feel free to reach out to us!
CloudQuery is an open-source, high-performance data integration framework built for developers, with support for a wide range of plugins.
CloudQuery extracts, transforms, and loads configuration from cloud APIs to a variety of supported destinations such as databases, data lakes, or streaming platforms for further analysis.
To ingest OpenTelemetry traces, metrics, and logs from CloudQuery, install the Datadog Agent version >=6.48.0 or >=7.48.0.
Alternatively, you can use OpenTelemetry Collector and Datadog Exporter as described below.
After you have the collector ready, specify the endpoint in the source spec:
kind:sourcespec:name:"aws"path:"cloudquery/aws"# Replace with the AWS source plugin versionversion:"<VERSION_SOURCE_AWS>"tables:["aws_s3_buckets"]destinations:["postgresql"]otel_endpoint:"0.0.0.0:4318"otel_endpoint_insecure:truespec:
Restart the Datadog agent for the change to take effect.
After you have the Agent ready, specify the endpoint in the source spec:
kind:sourcespec:name:"aws"path:"cloudquery/aws"# Replace with the AWS source plugin versionversion:"<VERSION_SOURCE_AWS>"tables:["aws_s3_buckets"]destinations:["postgresql"]otel_endpoint:"0.0.0.0:4318"otel_endpoint_insecure:truespec:
Pass the DD_OTLP_CONFIG_RECEIVER_PROTOCOLS_HTTP_ENDPOINT environment variable to the Datadog Agent with a value of 0.0.0.0:4318.
If you’re using Docker compose, see the example below:
Restart the Datadog agent for the change to take effect.
After you have the Agent ready, specify the endpoint in the source spec:
kind:sourcespec:name:"aws"path:"cloudquery/aws"# Replace with the AWS source plugin versionversion:"<VERSION_SOURCE_AWS>"tables:["aws_s3_buckets"]destinations:["postgresql"]otel_endpoint:"0.0.0.0:4318"otel_endpoint_insecure:truespec:
Run cloudquery sync spec.yml.
After ingestion starts, you should start seeing the traces in the Datadog APM Traces Explorer.
You can also validate metrics and logs in the Metrics Summary and Log Explorer.
If you use the OpenTelemetry collector, you can stop it by running docker stop <container_id>.
If you use the Datadog Agent, remove the configuration or environment variables you added and restart the agent.
Finally, delete the dashboard from your Datadog account.