Vector v0.8.0 release notes

Code name A Wholesome Platter Of Features

Upgrading Vector
When upgrading, we recommend stepping through minor versions as these can each contain breaking changes while Vector is pre-1.0. These breaking changes are noted in their respective upgrade guides.

Highlights

Automatically merge partial Docker events

Author photo for Ben Johnson
Ben Johnson
type: enhancement domain: sources source: docker
Improved Multiline Support In The File Source

Author photo for Ben Johnson
Ben Johnson
type: enhancement domain: sources source: file
Improved Syslog Parsing

Author photo for Ben Johnson
Ben Johnson
type: new feature domain: sources source: syslog
Lots of New Sinks!

Author photo for Ben Johnson
Ben Johnson
type: new feature domain: sinks
New Rename Fields Transform

Author photo for Ben Johnson
Ben Johnson
type: new feature domain: transforms transform: rename_fields
New Swimlanes Transform

Author photo for Ben Johnson
Ben Johnson
type: new feature domain: transforms transform: swimlanes
The Add Fields Transform Supports Templating

Author photo for Ben Johnson
Ben Johnson
type: enhancement domain: transforms transform: add_fields

Changelog

14 new features

new sink Initial gcp_stackdriver_logging sink implementation 1555 socket sink Add unix domain socket support to the socket sink 1561 new transform New merge transform 1504 new sink Initial logdna sink implementation 1668 cli Support multiple configuration files. 1725 new sink Initial humio_logs sink implementation 1716 config Option to reload config on file change 1330 config Global default log schemas 1769 new sink Initial loki sink 1783 kubernetes source Add more include_container_names, include_pod_uids, and include_namespaces filters 1501 new sink Initial influxdb_metrics sink implementation 1759 new sink Initial gcp_cloud_storage sink implementation 1794 new transform Initial rename_fields transform implementation 1800 new transform Add swimlanes transform 1785

24 enhancements

aws_cloudwatch_logs sink Enable more logging by default 1564 coercer transform Add new drop_unspecified option to drop unspecified fields 1636 cli Colourize help 1660 aws_s3 sink Add several S3 object-level options (grant_full_control, server_side_encryption, and more) 1689 docker source Add auto_partial_merge to automatically merge partial events 1504 observability Warn log for non retryable requests 1706 observability Add proper non retry messages 1712 config Clarify topology warnings 1726 topology Improve cyclic deps error message 1728 aws provider Add support for assume_role to all AWS sinks 1722 syslog source Improve best effort support for Syslog formats (5424, 3164, nginx style, etc) 1757 cli Improve vector generate syntax and formatting 1773 cli Test sub command improvements 1739 kafka source Support advanced librdkafka options 1830 kafka sink Support advanced librdkafka options 1829 add_fields transform Support templating for dynamic values 1799 log data model Support Array and Map kinds in Value 1836 config Allow multiple unit test inputs 1824 config Add no_outputs_from field to unit tests 1817 file source Better multi-line support 1852 kafka source Add support for TLS 1893 log data model Support null values in log events 1898 clickhouse sink Add timestamp_format field 1634 observability Enable rdkafka by default 1918

11 bug fixes

aws_s3 sink Fix a bug with retry_limit is set to 1 1569 socket sink Allow for non-IP address host names 1575 aws_kinesis_firehose sink Use describe_delivery_stream AWS API method for healthcheck 1573 rpm platform Create vector user when installing RPM package 1583 docker source Always check containers for self 1525 journald source Fix the journalctl start date to work across all timezones 1627 rpm platform Fix group creation in the RPM package 1654 sematext sink Fix EU endpoint and docs 1657 json_parser transform only drop source field if JSON parse succeeds 1863 lua transform Respect Lua types when converting back to events (#857) 1886 kubernetes source Use checksum fingerprinting 1912

106 chore

website Make sorting of blog posts stable 1566 operations Add AWS API key for Windows tests in CI 1565 operations Pass CIRCLE_SHA1 environment variable to release-github job 1567 operations Allow building on Windows Stable Rust 1560 Bump version to 0.8.0 to fix make check-version operations Update Cargo.lock website Escape special characters in options descriptions 1580 website Check that all blog articles are signed in CI 1459 website Fix broken s3 link website Fix avatar on blog list page website Redo blog sigs operations Support bug fixing releases 1587 operations Add all generated files to the release commit 1588 operations Do not require systemd as an RPM dependency 1590 operations Add release-push target to the Makefile 1589 testing Wrap failing test in feature flag 1595 operations Fix release-github CI job 1600 Run make generate operations Fix release-homebrew CI job 1601 website Add Netlify _redirects file website Force netlify redirects website Fix service provider filters in components section Fix format errors website Setup Netlify proxy for test-results subdomain website Setup Netlify proxy for sh subdomain testing Disable kubernetes tests in CI temporarily 1629 event Event::extend use FromIter 1631 buffers Introduce JsonArrayBuffer buffer 1633 operations Cleanup generate and check Dockerfiles 1623 security upgrade http and prost-build deps 1638 security add cargo-deny check for advisories 1640 Upgrade to rustc 1.41.0 1646 operations Add run.sh to run commands through Docker based on the USE_DOCKER env var 1637 new sink Initial sematext sink implementation 1562 Upgrade all dependencies 1648 website Add Ana 🎉 1649 Update to new lockfile format 1655 http sink Refactor internal http sink to use new helper API 1641 testing Add ability to verify RPM artifacts locally 1647 website Update Twitter handle to vectordotdev 1664 operations Fix creation of the tag in make release operations Use all tags in make release operations Fix nix verifier step (and nightly builds) 1669 security flesh out security policy 1642 operations Fix COPY path for armv7 Docker image 1671 operations Add .github/labels.yml for syncing labels 1677 operation Fix labels.yml path in label-syncer workflow operations Cleanup unused labels operations Define a JSON schema for the .meta/**/*.toml files 1678 Upgrade tracing-subscriber 0.2.0-alpha.5 1681 Fix the SECURITY.md link at CONTRIBUTING.md 1682 Remove background checks on security page operations Fixup versions in tracing-metrics 1690 operations Use rust-toolchain file when building CI Docker images 1691 sematext sink Rename cloud and add host 1704 Upgrade to tracing-subscriber 0.2.0 1707 website Allow partials in /.meta/*.toml files 1715 elasticsearch sink Drop aws endpoint and region options 1703 sematext sink make host calculation more explicit 1720 Add providers to labels and semantic PR scopes operations Allow running all tests locally 1701 operations Restore rust-toolchain file in the project root 1729 operations Fix test-stable CI job 1730 Replace Alexey with Luke 1723 operations Improve docker-run.sh script 1733 operations Add support for running containers under Podman 1736 operations Disable failing CI check operations Fix loading of private keys in separate files for sinks 1749 operations Use the “minimal” profile when installing with rustup 1747 operations Fix verify-nixos CI check 1760 website Fix nested field documentation 1765 humio_logs sink Remove encoding option 1767 operations Support conditionally rebuilding the docker images 1744 website Add units to default value examples Clarify generate error messages with type 1780 website Reduce homepage animation refresh rate testing Add behavior tests for add_fields and remove_fields transforms 1781 website Stop homepage animation after a timeout cli Support schema settings in unit tests 1793 operations Disable failing CI check Add templating as a domain windows platform Correct lints and tests 1789 Fix generate check testing Add more behavior tests for transforms 1811 Add field order test at src/event/discriminant.rs 1822 website Update to docusaurus 2.0.0-alpha.41 1831 Ensure zero output event tests fail 1814 website Update to docusaurus 2.0.0-alpha.43 Make token optional 1837 transforms Add transform context 1855 transforms Initial Kubernetes WatchClient 1746 Run make generate docs Re-run make generate to fix GCS docs 1877 testing Add feature disable-resolv-conf to make Vector tests pass on NixOS 1874 log data model Use BTreeMap instead of HashMap for logs and metrics 1838 Add description and bio to press page 1884 sematext_logs sink Rename to sematext_logs 1871 kubernetes source Change timestamp_key back to message_key 1887 testing Reduce RAM usage when running make test 1901 clickhouse sink Nest request fields Fix swimlanes documentation Fix make check-code Prepare v0.8.0 release Relax the requirements for no_outputs_from unit test targets 1921 operations Fix build with --no-default-features 1920 testing Allow kubernetes tests to compile 1911

Download Version 0.8.0

Linux
tar.gz
ARM64 ARMv7 x86_64
Linux (deb)
deb
ARM64 ARMv7 x86_64
Linux (rpm)
rpm
ARM64 ARMv7 x86_64
macOS
tar.gz
x86_64 ARM64
Windows
zip
x86_64
Windows (MSI)
msi
x86_64
browse all files...