Whitelist and Blacklist Fields When Encoding
More control over which fields are included when encoding
We’ve added the ability to white-list and blacklist fields during the encoding
process within sinks. This is useful if you have metadata fields
that you do not want to send downstream. For example, you might have an
application_id
fields that you use for partitioning, but you don’t want to
include it in the actual data since it would be duplicative.
To use this feature see the new encoding
options for each sink. For example,
the clickhouse
sink’s encoding
option.