Previous

Next

WhyLabs Overview

WhyLabs - Models

WhyLabs - Datasets

Overview

WhyLabs is a platform built to help organizations monitor, manage, and optimize Artificial Intelligence (AI) applications. It provides a suite of tools to ensure that machine learning (ML) models remain reliable, transparent, and fair throughout their entire lifecycle. The platform leverages monitoring and observability techniques to track model performance, identify issues like data drift or anomalies, and support teams in maintaining high-quality predictions.

This integration ingests WhyLabs data as logs, metrics, and events in Datadog:

Metrics

• Classification performance
• Regression performance

Logs

• Resources
• Entity Schema
• Anomalies
• Segments

Events

The Datadog integration configuration is validated to ensure all required settings are correctly configured before proceeding, followed by tracking authentication events during data ingestion to ensure secure access and proper user verification after the configuration validation.

Dashboards

This integration includes three out-of-the-box dashboards:

1. WhyLabs Overview: Provides a comprehensive view of the platform, allowing you to monitor and manage machine learning models and datasets. It highlights key areas such as resources, anomalies, segments, inputs, outputs, and columns.
2. WhyLabs - Models: Focuses on essential elements like the model summary, detected anomalies, segments, active monitors, inputs, and outputs. It offers a detailed view of the model’s performance and behavior in production.
3. WhyLabs - Datasets: Displays an overview of the dataset datatype, emphasizing key areas such as the model summary, anomalies, segments, active monitors, columns, and discreteness status.

Support

For support or feature requests, contact Crest Data through the following channels:

• Support email: datadog.integrations@crestdata.ai
• Sales email: datadog-sales@crestdata.ai
• Website: crestdata.ai
• FAQ: Crest Data Datadog Marketplace Integrations FAQ

This application is made available through the Datadog Marketplace and is supported by a Datadog Technology Partner. To use it, purchase this application in the Marketplace.