Remap support for the filter transform

Use VRL to specify conditions for filtering events in a stream

The filter transform for Vector enables you to winnow down a stream of events to only those that match a specified condition.

Previously, the filter transform required you to specify conditions using check_fields. But now you can use Vector Remap Language expressions in the remap transform to specify those conditions. This should make using filter more natural and expressive.


The example configuration below shows the same filter transform using the old system (check_fields) and the new system (remap):

type = "filter"
inputs = ["http-server-logs"]f

# Using check_fields
condition.type = "check_fields" = 200 = "info" = "debug"

# Using remap
condition.type = "remap"
condition.source = '.status_code != 200 && !includes(["info", "debug"], .severity)'