Prerequisites

LanguageLibraryMinimal tracer versionRecommended tracer version
Javakafka-clients (Lag generation is not supported for v3.7)1.9.01.43.0
Goconfluent-kafka-go1.56.11.66.0 or later
Sarama1.56.11.66.0 or later
Node.jskafkajs2.39.0 or 3.26.0 or 4.5.05.25.0 or later
Pythonconfluent-kafka1.16.02.11.0 or later
.NETConfluent.Kafka2.28.02.41.0 or later
Kafka Streams is partially supported for Java, and can lead to latency measurements being missed.

Setting up Data Streams Monitoring

See setup instructions for Java, Go, Node.js, Python, or .NET.

Monitoring Kafka Pipelines

Data Streams Monitoring uses message headers to propagate context through Kafka streams. If log.message.format.version is set in the Kafka broker configuration, it must be set to 0.11.0.0 or higher. Data Streams Monitoring is not supported for versions lower than this.

PREVIEWING: may/add-limitnofile-op-troubleshooting