Kafka for Data Streams Monitoring

Docs > Data Streams Monitoring > Kafka for Data Streams Monitoring

Prerequisites

Datadog Agent v7.34.0 or later

Monitoring Kafka Pipelines

Data Streams Monitoring uses message headers to propagate context through Kafka streams. If log.message.format.version is set in the Kafka broker configuration, it must be set to 0.11.0.0 or higher. Data Streams Monitoring is not supported for versions lower than this.

Support for Kafka in Data Streams Monitoring

Language	Technology	Minimal tracer version	Recommended tracer version
Java	kafka-clients (v3.7 is not fully supported)	1.9.0	1.43.0
Go	confluent-kafka-go	1.56.1	1.66.0 or later
Go	Sarama	1.56.1	1.66.0 or later
Node.js	kafkajs	2.39.0 or 3.26.0 or 4.5.0	5.25.0 or later
Python	confluent-kafka	1.16.0	2.11.0 or later
.NET	Confluent.Kafka	2.28.0	2.41.0 or later

Note

Kafka Streams is partially supported for Java, and can lead to latency measurements being missed in many cases