Amazon FSx

Overview

Amazon FSx is a fully managed service that provides scalable storage for NetApp ONTAP, OpenZFS, Windows File Server, and Lustre file systems.

Enable this integration to see all your FSx metrics in Datadog.

Setup

Installation

If you haven’t already, set up the Amazon Web Services integration first.

Metric collection

  1. In the AWS integration page, ensure that FSx is enabled under the Metric Collection tab.

  2. Add the following permissions to your Datadog IAM policy in order to collect Amazon FSx metrics.

    AWS PermissionDescription
    fsx:ListTagsForResourceUsed to add FSx custom tags.
    fsx:DescribeFileSystemsUsed to provide storage and throughput capacity.

  3. Install the Datadog - Amazon FSx integration.

Log collection

Audit event logs for FSx for Windows File Server

To track all user accesses of individual files, folders, and file shares, integrate the audit event logs from your FSx for Windows File Server:

  1. Enable the file access auditing feature for your file systems and send the logs to CloudWatch.
  2. If you haven’t already, set up the Datadog log collection AWS Lambda function (version 3.35.0+).
  3. Once the Lambda function is installed, manually add a trigger on the /aws/fsx/windows CloudWatch log group in the AWS console:
    cloudwatch log group
    Select the corresponding CloudWatch Log group, add a filter name (or leave the filter empty), and add the trigger:
    cloudwatch trigger
  4. Go to the Datadog Log section to start exploring your logs!

Note: You can also send these logs to Datadog with Amazon Data Firehose, but you must create a custom log processor to get the same log parsing functionality and search experience.

FSx API activity

Amazon FSx is integrated with AWS CloudTrail which tracks every FSx action taken by a user, role, or AWS service. Enable Datadog’s CloudTrail Integration to monitor all FSx API calls in your AWS account.

Metrics

aws.fsx.age_of_oldest_queued_message
(gauge)		The average age of the oldest message waiting to be exported.
Shown as second
aws.fsx.age_of_oldest_queued_message.maximum
(gauge)		The maximum number of seconds a message lived in the export queue.
Shown as second
aws.fsx.age_of_oldest_queued_message.minimum
(gauge)		The minimum number of seconds a message lived in the export queue.
Shown as second
aws.fsx.capacity_pool_read_bytes
(count)		The total number of bytes read from the file system's capacity pool tier over a specified period.
Shown as byte
aws.fsx.capacity_pool_read_operations
(count)		The total number of read operations from the file system's capacity pool tier over a specified period.
Shown as operation
aws.fsx.capacity_pool_write_bytes
(count)		The total number of bytes written to the file system's capacity pool tier over a specified period.
Shown as byte
aws.fsx.capacity_pool_write_operations
(count)		The total number of write operations to the file system's capacity pool tier over a specified period.
Shown as operation
aws.fsx.client_connections
(count)		The number of active connections between clients and the file server.
Shown as connection
aws.fsx.compression_ratio
(gauge)		Ratio of compressed storage usage to uncompressed storage usage.
aws.fsx.cpuutilization
(gauge)		The average CPU utilization of the file system over a specified period.
Shown as percent
aws.fsx.cpuutilization.maximum
(gauge)		The highest CPU utilization of the file system over a specified period.
Shown as percent
aws.fsx.cpuutilization.minimum
(gauge)		The lowest CPU utilization of the file system over a specified period.
Shown as percent
aws.fsx.data_read_bytes
(count)		The total number of bytes for file system read operations.
Shown as byte
aws.fsx.data_read_bytes.average
(gauge)		The average number of bytes associated with read operations per disk.
Shown as byte
aws.fsx.data_read_bytes.maximum
(gauge)		The maximum number of bytes associated with read operations on a single disk.
Shown as byte
aws.fsx.data_read_bytes.minimum
(gauge)		The minimum number of bytes associated with read operations on a single disk.
Shown as byte
aws.fsx.data_read_bytes.samplecount
(count)		The number of disks on the file system.
aws.fsx.data_read_operation_time
(count)		The total number of seconds spent by read operations during the specified period.
Shown as second
aws.fsx.data_read_operations
(count)		The number of read operations.
Shown as operation
aws.fsx.data_read_operations.average
(gauge)		The average number of read operations per disk.
Shown as operation
aws.fsx.data_read_operations.maximum
(gauge)		The maximum number of read operations on a single disk.
Shown as operation
aws.fsx.data_read_operations.minimum
(gauge)		The minimum number of read operations on a single disk.
Shown as operation
aws.fsx.data_read_operations.samplecount
(count)		The number of disks on the file system.
aws.fsx.data_write_bytes
(count)		The total number of bytes for file system write operations.
Shown as byte
aws.fsx.data_write_bytes.average
(gauge)		The average number of bytes for file system write operations per disk.
Shown as byte
aws.fsx.data_write_bytes.maximum
(gauge)		The maximum number of bytes for file system write operations on a single disk.
Shown as byte
aws.fsx.data_write_bytes.minimum
(gauge)		The minimum number of bytes for file system write operations on a single disk.
Shown as byte
aws.fsx.data_write_bytes.samplecount
(count)		The number of disks on the file system.
aws.fsx.data_write_operation_time
(count)		The total number of seconds spent by write operations during the specified period.
Shown as second
aws.fsx.data_write_operations
(count)		The number of write operations.
Shown as operation
aws.fsx.data_write_operations.average
(gauge)		The average number of write operations per disk.
Shown as operation
aws.fsx.data_write_operations.maximum
(gauge)		The maximum number of write operations on a single disk.
Shown as operation
aws.fsx.data_write_operations.minimum
(gauge)		The minimum number of write operations on a single disk.
Shown as operation
aws.fsx.data_write_operations.samplecount
(count)		The number of disks on the file system.
aws.fsx.deduplication_saved_storage
(gauge)		The amount of storage space saved by data deduplication, if it is enabled.
Shown as byte
aws.fsx.disk_iops_utilization
(gauge)		The average disk IOPS utilization of the file system over a specified period.
Shown as percent
aws.fsx.disk_iops_utilization.maximum
(gauge)		The maximum disk IOPS utilization of the file system over a specified period.
Shown as percent
aws.fsx.disk_iops_utilization.minimum
(gauge)		The minimum disk IOPS utilization of the file system over a specified period.
Shown as percent
aws.fsx.disk_read_bytes
(count)		The total number of bytes read from the file system over a specified period.
Shown as byte
aws.fsx.disk_read_operations
(count)		The total number of read operations from the primary tier over a specified period.
Shown as operation
aws.fsx.disk_throughput_balance
(gauge)		The percentage of available burst credits for disk throughput for the storage volumes.
Shown as percentage
aws.fsx.disk_throughput_utilization
(gauge)		The average disk throughput between your file server and its storage volumes.
Shown as percentage
aws.fsx.disk_throughput_utilization.maximum
(gauge)		The maximum disk throughput between your file server and its storage volumes.
Shown as percentage
aws.fsx.disk_throughput_utilization.minimum
(gauge)		The minimum disk throughput between your file server and its storage volumes.
Shown as percentage
aws.fsx.disk_write_bytes
(count)		The total number of bytes written from the file system over a specified period.
Shown as byte
aws.fsx.disk_write_operations
(count)		The total number of write operations from the primary tier over a specified period.
Shown as operation
aws.fsx.file_server_cache_hit_ratio
(gauge)		The average cache hit percent for the file system over a specified period.
Shown as percent
aws.fsx.file_server_disk_iops_balance
(gauge)		The average burst balance available for disk IOPS over a specified period.
Shown as percent
aws.fsx.file_server_disk_iops_balance.maximum
(gauge)		The maximum burst balance available for disk IOPS over a specified period.
Shown as percent
aws.fsx.file_server_disk_iops_balance.minimum
(gauge)		The minimum burst balance available for disk IOPS over a specified period.
Shown as percent
aws.fsx.file_server_disk_iops_utilization
(gauge)		The average disk IOPS utilization of the file system over a specified period.
Shown as percent
aws.fsx.file_server_disk_iops_utilization.maximum
(gauge)		The maximum disk IOPS utilization of the file system over a specified period.
Shown as percent
aws.fsx.file_server_disk_iops_utilization.minimum
(gauge)		The minimum disk IOPS utilization of the file system over a specified period.
Shown as percent
aws.fsx.file_server_disk_throughput_balance
(gauge)		The average burst balance available for disk throughput over a specified period.
Shown as percent
aws.fsx.file_server_disk_throughput_balance.maximum
(gauge)		The maximum burst balance available for disk throughput over a specified period.
Shown as percent
aws.fsx.file_server_disk_throughput_balance.minimum
(gauge)		The minimum burst balance available for disk throughput over a specified period.
Shown as percent
aws.fsx.file_server_disk_throughput_utilization
(gauge)		The average percent utilization of the file servers' disk throughput over a specified period.
Shown as percent
aws.fsx.file_server_disk_throughput_utilization.maximum
(gauge)		The highest percent utilization of the file servers' disk throughput over a specified period.
Shown as percent
aws.fsx.file_server_disk_throughput_utilization.minimum
(gauge)		The lowest percent utilization of the file servers' disk throughput over a specified period.
Shown as percent
aws.fsx.files_capacity
(gauge)		The total number of inodes that can be created on the volume.
Shown as file
aws.fsx.files_used
(count)		The used files (number of files or inodes) on the volume.
Shown as file
aws.fsx.free_data_storage_capacity
(gauge)		The average number of bytes available per disk.
Shown as byte
aws.fsx.free_data_storage_capacity.maximum
(gauge)		The total number of bytes available in the disk with the most remaining available storage.
Shown as byte
aws.fsx.free_data_storage_capacity.minimum
(gauge)		The total number bytes available in the fullest disk.
Shown as byte
aws.fsx.free_data_storage_capacity.samplecount
(count)		The number of disks on the file system.
aws.fsx.free_data_storage_capacity.sum
(count)		The total number of bytes available in the file system.
Shown as byte
aws.fsx.free_storage_capacity
(gauge)		The average amount of available storage capacity.
Shown as byte
aws.fsx.free_storage_capacity.minimum
(gauge)		The minimum amount of available storage capacity.
Shown as byte
aws.fsx.logical_data_stored
(count)		The total amount of logical data stored on the file system.
Shown as byte
aws.fsx.logical_disk_usage
(count)		The total number of logical bytes stored in the file system.
Shown as byte
aws.fsx.logical_disk_usage.average
(gauge)		The average number of logical bytes stored per disk.
Shown as byte
aws.fsx.logical_disk_usage.maximum
(gauge)		The largest number of logical bytes stored in a disk in the file system.
Shown as byte
aws.fsx.logical_disk_usage.minimum
(gauge)		The least number of logical bytes stored in a disk in the file system.
Shown as byte
aws.fsx.memory_utilization
(gauge)		The average utilization of your file server's memory resources.
Shown as percent
aws.fsx.memory_utilization.maximum
(gauge)		The highest utilization of your file server's memory resources.
Shown as percent
aws.fsx.memory_utilization.minimum
(gauge)		The lowest utilization of your file server's memory resources.
Shown as percent
aws.fsx.metadata_operation_time
(count)		The total number of seconds spent by read operations during the specified period.
Shown as second
aws.fsx.metadata_operations
(count)		The number of metadata operations.
Shown as operation
aws.fsx.metadata_operations.average
(gauge)		The average number of metadata operations per disk.
Shown as operation
aws.fsx.network_received_bytes
(count)		The total number of bytes received by the file system over a specified period.
Shown as byte
aws.fsx.network_sent_bytes
(count)		The total number of bytes sent by the file system over a specified period.
Shown as byte
aws.fsx.network_throughput_utilization
(gauge)		The average network throughput utilization of the file system.
Shown as percent
aws.fsx.network_throughput_utilization.maximum
(gauge)		The highest network throughput utilization of the file system.
Shown as percent
aws.fsx.network_throughput_utilization.minimum
(gauge)		The lowest network throughput utilization of the file system.
Shown as percent
aws.fsx.nfs_bad_calls
(count)		Number of calls rejected by NFS server Remote Procedure Call (RPC) mechanism.
Shown as unit
aws.fsx.physical_disk_usage
(count)		The total number of bytes occupied in disks in the file system.
Shown as byte
aws.fsx.physical_disk_usage.average
(gauge)		The average number of bytes occupied per disk.
Shown as byte
aws.fsx.physical_disk_usage.maximum
(gauge)		The total number of bytes occupied in the fullest disk.
Shown as byte
aws.fsx.physical_disk_usage.minimum
(gauge)		The total number of bytes occupied in the emptiest disk.
Shown as byte
aws.fsx.repository_rename_operations
(count)		The total number of rename operations that result from a directory rename.
Shown as operation
aws.fsx.repository_rename_operations.average
(gauge)		The average number of rename operations for the file system.
Shown as operation
aws.fsx.storage_capacity
(gauge)		The total storage capacity of the primary (SSD) tier.
Shown as byte
aws.fsx.storage_capacity
(gauge)		The total storage capacity.
Shown as byte
aws.fsx.storage_capacity.average
(count)		Total storage capacity, equal to the sum of used and available storage capacity.
Shown as byte
aws.fsx.storage_capacity_utilization
(gauge)		The percentage of the volume's used physical disk space.
Shown as percent
aws.fsx.storage_efficiency_savings
(gauge)		The average storage efficiency savings over a specified period.
Shown as byte
aws.fsx.storage_used
(count)		The total amount of physical data stored on the file system.
Shown as byte
aws.fsx.throughput_capacity
(gauge)		The throughput capacity of your storage.
Shown as byte
aws.fsx.used_storage_capacity
(gauge)		The amount of storage used.
Shown as byte

Events

The Amazon FSx integration does not include any events.

Service Checks

The Amazon FSx integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.

PREVIEWING: esther/docs-8632-slo-blog-links