0.44 Upgrade Guide

Table of Contents

Breaking Changes:

1. Clickhouse Sink skip_unknown_fields changes
2. File source ignored_header_bytes and lines fix
3. Some VRL functions are now fallible

Clickhouse Sink skip_unknown_fields changes

The skip_unknown_fields behavior was changed:

• skip_unknown_fields is true: enables skipping unknown fields (overrides the server’s default)
• skip_unknown_fields is false: enables “strict” mode and does not allow skipping unknown fields for the request, (overrides the server’s default)
• skip_unknown_fields is not set: follows the server’s default

Double-check your configuration and update the setting per above.

File source ignored_header_bytes and lines fix

When sourcing from compressed files, ignored_header_bytes no longer looks at the compressed file’s bytes (which would include the magic bytes for the compression header). Instead, it ignores the bytes from the uncompressed content. Similarly, lines no longer looks for new line delimiters in the compressed content, but the uncompressed content.

Some VRL functions are now fallible

to_unix_timestamp, to_float, and uuid_v7 can now return an error if the supplied timestamp is unrepresentable as a nanosecond timestamp. Previously the function calls would panic. VRL scripts using the above functions need to be updated to handle potential errors.