The Vector blog on Vector

Celebrating COSE's First Year

Thu, 13 Nov 2025 00:00:00 +0000

Our journey

In October 2024, the COSE (Community Open Source Engineering) team was formed with the mission to strengthen Vector’s open source foundation and improve the developer experience. Today, we’re celebrating our first year by highlighting the contributions we’ve made to the Vector community. The COSE team has committed over 550 changes to Vector, across 8 major releases (0.43.0 through 0.51.0).

Highlights - February 2025

Wed, 12 Feb 2025 00:00:00 +0000

In this blog post we want to highlight some recently added features and guides.

Features

A new OpenTelemetry sink is now available. You can find a quickstart guide here.
- We have more plans here such as gRPC support and smart grouping at the sink.
We introduced a new exclusive route transform. You can read more in our release highlight.
Apple Silicon builds are now available in our downloads page. Note that these are available since v0.44.0 and won’t show up for older versions.
A new type of enrichment_table, called memory, was introduced! This table can also function as a sink and addresses several new use cases. See this release highlight for details.
The VRL function library keeps growing thanks to community contributions! You can read more:
- 0.21.0 Features
- 0.20.0 Features

Guides

We recently added a new guide category: Development.

Log Namespacing

Fri, 30 Jun 2023 00:00:00 +0000

Please visit our log namespace guide for more details.

The Vector team has been hard at work improving the data model of events in Vector. These changes are now available for beta testing for those who want to try it out and give feedback. This is an opt-in feature. Nothing should change unless you specifically enable it.

Monitoring Vector's per-component memory usage

Wed, 14 Dec 2022 00:00:00 +0000

We are excited to announce that Vector now has support for exposing per-component memory usage metrics. This work addresses an often-requested feature from users who want to understand how Vector uses memory, and what parts of their configurations are responsible for high memory usage.

Trying it out

Vector Remap Language

Mon, 15 Feb 2021 00:00:00 +0000

Vector Remap Language (VRL) is an expression-oriented language designed to work with observability data (logs and metrics) in a safe and performant manner. It features a simple syntax, a rich set of built-in functions tailored to observability use cases, and numerous features that set it far apart from other options. This 0.12 release of Vector marks the official release of the language.

Accelerating Vector with Datadog

Thu, 11 Feb 2021 00:00:00 +0000

We’re excited to announce that Timber and Vector are now officially part of Datadog!

When we started building Vector, we set out to provide an entirely new kind of data pipeline. We were guided by a belief that when it comes to collecting, transforming, and routing observability data, teams shouldn’t have to accept trade-offs between cost, performance, reliability, and security. They also shouldn’t have to stitch together disparate tools just to get their data from point A to B; the ideal solution should be simple, yet robust, and unify the entire pipeline. We’ve dedicated ourselves to that challenge, and we’re proud of the platform we’ve created.

The new GraphQL API for Vector

Tue, 08 Dec 2020 00:00:00 +0000

Although Vector is an observability tool, it’s nonetheless important to be able to observe Vector itself, especially in production environments where it serves as critical infrastructure. That’s why we’re excited to announce the new Vector GraphQL API, available in v0.11.0.

The API enables ad-hoc querying of:

Your Vector topology, including sources, transforms and sinks.
Uptime and health information.
Event processing, byte processing, and error metrics, both per component and in aggregate across the Vector instance.
Changes to your pipeline configuration, in real time.

This is just the beginning. In the near future, the API will enable you to both observe and control Vector remotely, programmatically, and on demand. Stay tuned!

First-class Kubernetes integration for Vector

Thu, 26 Nov 2020 00:00:00 +0000

After months of development, over 100 pull requests, and intensive QA in clusters producing over 20 terabytes of event data a day, we’re pleased to announce our first-class Kubernetes integration for Vector in version 0.11. We strove to make even this initial integration rock solid and production ready because we aim to make Vector the default pipeline for all Kubernetes observability data.

To cut straight to the chase, checkout the installation instructions, otherwise read on for the details.

Adaptive request concurrency. Resilient observability at scale.

Tue, 24 Nov 2020 00:00:00 +0000

Observability pipelines have become critical infrastructure in the current technological landscape, which is why we’ve built Vector to provide extremely high throughput with the tiniest resource footprint we can manage (Rust is a huge help here). But this is not enough in the real world: your observability pipeline needs to provide optimal performance and efficiency while also being a good infrastructure citizen and playing nicely with services like Elasticsearch and Clickhouse.

And so we’re excited to announce that Vector version 0.11 includes support for Adaptive Request Concurrency (ARC) in all of its HTTP-based sinks. This feature does away with static rate limits and automatically optimizes HTTP concurrency limits based on downstream service responses. The underlying mechanism is a feedback loop inspired by TCP congestion control algorithms.

How we test Vector

Mon, 13 Jul 2020 00:00:00 +0000

When we set out to build Vector, we knew that reliability and performance were two of our top priorities. We also knew that even the best of intentions would not be enough to make certain those qualities were realized and reflected in our users’ production deployments. Since then, we’ve been continuously evolving and expanding our approach to achieving that level of quality.

Introducing Vector

Mon, 13 Jul 2020 00:00:00 +0000

Today we’re very excited to open source the Vector project! Vector is a tool for building flexible and robust pipelines for your logs and metrics data. We’re still in the early stages, but our goal with Vector is to dramatically simplify your observability infrastructure while making it easy to get more value from your data.