Vector v0.4.0 Release Notes

Released by Ben,
The easiest way to stay up-to-date. One email on the 1st of every month. No spam, ever.

We're excited to release Vector v0.4.0! Vector follows semantic versioning, and this is an initial dev release. This release brings 12 new features, 45 enhancements, 14 bug fixes, 1 perf improvement. Checkout the highlights for notable features and, as always, let us know what you think!


12 New Features

elasticsearch sink Support AWS authentication

new sink New `file` sink

new sink Initial `clickhouse` sink implementation

new sink Initial `aws_cloudwatch_metrics` sink implementation

new source Initial `journald` source implementation

new source Add new `kafka` source

new source Initial `udp` source implementation

new transform New `add_tags` transform

new transform New `remove_tags` transform

new transform add coercer transform

new transform add split transform

syslog source add all parsed syslog fields to event

45 Enhancements

aws_cloudwatch_logs sink Add dynamic group creation

aws_cloudwatch_logs sink Add retry ability to cloudwatch

aws_cloudwatch_logs sink Add cloudwatch partitioning and refactor partition buffer

aws_kinesis_streams sink Add configurable partition keys

aws_s3 sink Add filename extension option and fix trailing slash

cli Add `--color` option and tty check for ansi colors

config Validation of sinks and sources for non-emptiness.

config reusable templating system for event values

config Improve configuration validation and make it more strict

config default config path "/etc/vector/vector.toml"

console sink accept both logs and metrics

elasticsearch sink Add support for custom query parameters

elasticsearch sink Add support for additional headers to the Elasticsearch sink

elasticsearch sink Add HTTP Basic authorization

elasticsearch sink use templates for ES index and S3 key prefix

elasticsearch sink Default `doc_type` to `_doc` and make it op…

file source favor older files and allow configuring greedier reads

file source allow aggregating multiple lines into one event

file source make fingerprinting strategy configurable

file source fall back to global data_dir option (#644)

file source Add File checkpoint feature.

file source log a single warning when ignoring small files

grok_parser transform add type coercion

http sink Add support for unverified HTTPS

journald source Add checkpointing support

log_to_metric transform use templates for metric names in log_to_metric

log_to_metric transform push Histogram and Set metrics from logs

log_to_metric transform output multiple metrics from a single log

lua transform Add tags support to log_to_metric transform

metric data model add tags into metrics model

metric data model add timestamps into metrics

metric data model Use floats for metrics values

observability Add rate limit notice when it starts

observability Initial rate limit subscriber

operations Build for x86_64-unknown-linux-musl with all features and optimized binary size

operations Add `jemallocator` feature flag

prometheus sink add namespace config

prometheus sink add labels support

prometheus sink Support sets

prometheus sink Support histograms

regex_parser transform Log when regex does not match

tcp sink Add support for TLS

tokenizer transform Convert "-" into "nil"

topology Add sink healthcheck disable

topology adjust transform trait for multiple output events

14 Bug Fixes

add_fields transform rename config tag

aws_cloudwatch_logs sink `encoding = "text"` overrides

aws_s3 sink retry HttpDispatch errors for s3 and kinesis

config reload with unparseable config

elasticsearch sink Make the headers and query tables optional.

log data model don't serialize MapValue::Null as a string

log data model unflatten event before outputting

networking Retry requests on timeouts

operations Fix docker nightly builds

operations Use GNU ld instead of LLVM lld for x86_64-unknown-linux-musl

operations Use OpenSSL instead of LibreSSL for x86_64-unknown-linux-musl

prometheus sink Update Metric::Set usage

security RUSTSEC-2019-0011 by updating crossbeam-epoch

topology It is now possible to reload a with a non-overlap…

1 Perf Improvement

observability Add initial rework of rate limited logs

Download this release