Vector v0.41.0 release notes

The Vector team is pleased to announce version 0.41.0!

In addition to the enhancements and fixes listed below, this release includes the following notable features:

  • A new greptimedb_logs sink was added for sending logs to GreptimeDB
  • A new static_metrics source was added for emitting preconfigured metrics on an interval. This can be useful for heartbeat-style metrics or for emitting a metric based on an environment variable.
  • Windows now supports automatic config reloading via --watch-config as exists on other *nix platforms.

There are no breaking changes or deprecations with this release and so no upgrade guide.

Upgrading Vector
When upgrading, we recommend stepping through minor versions as these can each contain breaking changes while Vector is pre-1.0. These breaking changes are noted in their respective upgrade guides.

Known issues

  • The vector source cannot receive events encoded by thevector sink #21252. This will be fixed in v0.41.1.

Changelog

4 enhancements

  • The geoip enrichment table now has support for the GeoIP2-Anonymous-IP MaxMind database type. Thanks to publicfacingusername for contributing this change!
  • The kafka sink now retries sending events that failed to be sent for transient reasons. Previously it would reject these events. Thanks to frankh for contributing this change!
  • The kafka sink now supports OIDC authentication through the exposed librdkafka_options. Thanks to zapdos26 for contributing this change!
  • Windows now supports the --watch-config command line parameter just like every other platform and will reload the configuration files on any change. Thanks to darklajid for contributing this change!

5 new features

  • VRL was updated to v0.18.0. This includes the following changes:

    New Features

    • Added unflatten function to inverse the result of the flatten function. This function is useful when you want to convert a flattened object back to its original form.
    • The parse_json function now accepts an optional lossy parameter (which defaults to true).

    This new parameter allows to control whether the UTF-8 decoding should be lossy or not, replacing invalid UTF-8 sequences with the Unicode replacement character (U+FFFD) if set to true or raising an error if set to false and an invalid utf-8 sequence is found. (https://github.com/vectordotdev/vrl/pull/269)

    Enhancements

    Fixes

    • decode_base64 no longer requires canonical padding. (https://github.com/vectordotdev/vrl/pull/960)
    • The assumption of a Datadog Logs-based intake event structure has been removed from the match_datadog_query function. (https://github.com/vectordotdev/vrl/pull/1003)
    • For the parse_influxdb function the timestamp and tags fields of returned objects are now correctly marked as nullable.
    • The loki sink now has the ability to send structured metadata via the added structured_metadata option.
  • The loki sink now has the ability to send structured metadata via the added structured_metadata option. Thanks to maxboone for contributing this change!

  • A new greptimedb_logs sink has been added to forward logs to Greptime.

    As part of this addition, the existing greptimedb sink was renamed to greptimedb_metrics.

    Thanks to GreptimeTeam for contributing this change!
  • A new static_metrics source was added. This source periodically emits preconfigured values. Thanks to esensar for contributing this change!
  • Support was added for configuring the endpoint of the honeycomb sink. This allows sending data to Honeycomb’s EU endpoint in addition to the default US endpoint. Thanks to raytung for contributing this change!

13 bug fixes

  • Support was added for fetching secrets from AWS secrets manager when using SSO profiles in a ~/.aws/config file. Thanks to britton-from-notion ycrliu for contributing this change!
  • The socket sink can now accept metric events when using codecs that support encoding metrics. Thanks to nichtverstehen for contributing this change!
  • An issue was fixed where the configuration watcher did not properly handle recursive directories. This fix ensures configuration will be reloaded when using the automatic namespacing feature of configuration loading. Thanks to ifuryst for contributing this change!
  • Log sources can now use metrics-only decoders such as the recently added influxdb decoder. Thanks to jorgehermo9 for contributing this change!
  • The influxdb decoder now uses nanosecond-precision for timestamps instead of microsecond-precision, as stated in InfluxDB’s documentation. Thanks to jorgehermo9 for contributing this change!
  • The kafka sink no longer emits warnings due to applying rdkafka options to a consumer used for the health check. Now it uses the producer client for the health check. Thanks to belltoy for contributing this change!
  • The amqp source no longer panics when deserializing metrics (such as the native_json codec). Thanks to kghost for contributing this change!
  • The datadog_search condition, which may be used in filter component conditions, now properly handles direct numeric type equality checks for log attributes.
  • The reduce transform can now reduce fields that contain special characters.
  • Vector no longer panics during configuration loading if a secret is used for a configuration option that has additional validation (such as URIs).
  • The file source now properly handle exclude patterns with multiple slashes when matching files. Thanks to suikammd for contributing this change!
  • The http_server source now properly writes all the specified query parameters to %http_server.query_parameters when log namespacing is enabled. Thanks to Zettroke for contributing this change!
  • The socket source now respects the global log_namespace setting. Thanks to Zettroke for contributing this change!

Download Version 0.41.0

Linux
tar.gz
ARM64 ARMv7 x86_64
Linux (deb)
deb
ARM64 ARMv7 x86_64
Linux (rpm)
rpm
ARM64 ARMv7 x86_64
macOS
tar.gz
x86_64
Windows
zip
x86_64
Windows (MSI)
msi
x86_64
browse all files...