Agent Architecture

Run Vector at your edge to democratize processing.

If you have a complex production environment that makes deploying Vector as an agent difficult, consider starting with the aggregator architecture or combine them for the unified architecture.


Overview

This agent architecture deploys Vector as an agent on each node for local data collection and processing.

Agent

Data can be collected directly by Vector, indirectly through another agent, or both simultaneously. Data processing can happen locally on the node or remotely in an aggregator.

When to Use This Architecture

We recommend this architecture for:

  • Simple environments that do not require high durability or high availability.
  • Use cases that do not need to hold onto data for long periods, such as fast, stateless processing and streaming delivery. (i.e., merging multi-line logs or aggregating host specific metrics).
  • Operators that can make node-level changes without a lot of friction.

If your use case violates these recommendations, consider the aggregator or unified architectures.

Going to Production

Architecting

See the architecting document for more detail.

High Availability

See the high availability document for more detail.

Hardening

See the hardening recommendations for more detail.

Sizing, Scaling, & Capacity Planning

Rolling Out

See the rolling out document for more detail.

Advanced

Working with Other Agents

We recommend deploying Vector alongside other agents that integrate with specific systems and produce unique data. Otherwise, Vector should replace the agent. See the collecting data section for more detail.

Processing at the Edge

As a general rule of thumb, agents should not hold onto data. Furthermore, processing and delivery of data should be fast and streaming. If you need to perform complex processing or long-lived batching, use the aggregator architecture.

Support

For easy setup and maintenance of this architecture, consider the Vector’s discussions or chat. These are free best effort channels. For enterprise needs, consider Datadog Observability Pipelines, which comes with enterprise-level support. In addition, we offer Datadog Premier Support Services for expert architectural guidance. Contact us for more information.