Observability Pipelines

Datadog Observability Pipelines enables you to aggregate, process, and route all your logs so you can make value-based decisions in your own infrastructure. You can easily dual ship, filter, sample, enforce quotas and more for increased efficiency, security, and flexibility—all within your own environment.

Cost-effective processing and routing of all your logs

Filter logs before you route them, reduce the size of your logs, and retain relevant fields
Stay within budget by imposing rule-based daily quotas or sampling strategies without losing access to mission-critical KPIs and trends
Select log destination based on priority and needs, routing noisy logs to an archive

Simplify migrations and reduce vendor lock-in

Dual-ship logs easily to ensure business continuity when migrating between vendors or using multiple solutions
Onboard new log data sources and destinations at your own pace without disrupting your existing workflows or sacrificing visibility
Take advantage of best-of-breed solutions with easy routing for different logging use cases

Meet your organization’s security and compliance requirements

Fully or partially redact sensitive data—such as credit cards, email addresses, IP addresses—before it leaves your environment using Datadog Sensitive Data Scanner
Comply with data residency laws and support Data Loss Prevention initiatives with full control over data routing, and enable built-in or user-defined rules to stay compliant with PCI, GDPR, HIPAA, CCPA, and more
Eliminate gaps in access control and ensure schema standardization by easily adding, copying, and dropping relevant attributes and tags

Build, monitor, and manage log pipelines through a single control plane

Get started with easy-to-use templates for common use cases such as dual shipping logs, reducing log volume, and archiving data
Easily create, deploy, and manage remotely your pipeline instances using a point-and-click UI
Monitor the health and performance of all pipelines deployed in your infrastructure in one centralized view, and get alerted on key issues