Join our mailing list. Simple monthly updates. No spam, ever.

Vector Makes Observability Data Simple

Vector is an open-source utility for collecting, transforming, and routing logs, metrics, and events.
Get Started Download
Source 1 Source 2 Source 3 Sink 1 Sink 2 Sink 3 Sources, Transforms and Sinks

Features

Blistering Fast

Blistering Fast

Built in Rust, Vector is blistering fast and memory efficient. It's designed to handle the most demanding environments.

Easy To Operate

Vendor Neutral

Vector does not favor any specific storage. It fosters a fair, open ecosystem with the user's best interest in mind.

Distributed or Centralized

Agent or Service

Vector aims to be the single, and only, tool needed to get data from A to B, deploying as an agent or service.

Logs or Metrics

Logs, Metrics, & Events

Vector unifies logs, metrics, and events at the source, making it collect and ship all observability data.

Programmable Transforms

Programmable Transforms

An embedded LUA engine makes it easy to program powerful transforms. Handle complex use cases without limitations.

Reliable Delivery

Clear Guarantees

Vector is clear on it's guarantees, helping you to make the appropriate trade offs for your use case.

Performance

{{ performance_tests[selected_performance_test].name }} Select a Test
  • {{ performance_test.name }}
{{ measurement.name }}
{{ measurement.label }}
{{ performance_tests[selected_performance_test].description }}

Correctness

VectorFilebeatFluentBitFluentDLogstashSplunkHFSplunkUF
Disk buffer persistence𝘅𝘅
File rotate (create)
File rotate (copytruncate)𝘅𝘅𝘅𝘅
File truncation
Process (SIGHUP)𝘅𝘅𝘅
TCP Streaming𝘅𝘅𝘅𝘅
JSON (wrapped)𝘅

One solution for any deployment model

Simple To Configure

vector.toml

Configuration Flow

[sources.logs]   
   type = 'file'
   include = ['/var/log/app*.log']
   start_at_beginning = false
   ignore_older = 3600

Define One Or More Data Sources
view all sources

[transforms.tokenizer]   
   inputs = ['logs']
   type = 'tokenizer'
   field_names = ["timestamp", "level", "message"]

Parse & Transform
view all transforms

[transforms.sampler]   
   inputs = ['tokenizer']
   type = 'sampler'
   hash_field = 'request_id'
   rate = 10

Transactionally Sample
view all transforms

[sinks.es_cluster]   
   inputs = ['sampler']
   type = 'elasticsearch'
   host = '123.123.123.123:5000'

Analyze & Search
view all sinks

[sinks.s3_archive]   
   inputs = ['tokenizer']
   type = 's3'
   region = 'us-east-1'
   bucket = 'log-archives'
   key_prefix = 'date=%F'

Archive & Backup
view all sinks

Gives You Super Powers

Gives You Super Powers

Ready to use Vector?

Get started by downloading Vector and following the install instructions.

Where We're Headed

v0.1 - Logs Support

Released

Basic log collection and shipping.

v0.2 - Metrics Support

Released

Basic metrics support in the context of logs: converting logs to metrics, outputting metrics to popular metrics storages.

v0.3 - Parsing & Transforming

Released

LUA runtime, Regex parser, Grok parser, tokenized parser, and more.

v0.4 - Schemas

In Dev

Ability to coerce values and define a schema, guaranteeing consistent normalized types for known fields.

v0.5 - Stream Consumers

Kafka, Kinesis, and SQS consumer sources.

v0.6 - Columnar Writing

CSV/ORC/Parquet, Big Query, ClickHouse, and more.

v0.7 - CLI

List vector instances, view topology, validate config changes, syphon test data, pre-flight testing, observability, and more.

v0.8 - Wire Level Tailing

Directly connect to vector instances and live tail the stream, compute aggregates, and get real-time millisecond latency.

v1.0

Stay In The Know!

Join our mailing list to stay current or checkout one of our community resources.