Compression Now Available In The Kafka Sink

Improve throughput by compressing data before writing it to Kafka

Page source Edit this page

Compression for Vector’s kafka sink is now available. Before we take credit for this feature, Vector uses librdkafka under the hood, and to maintain consistency we just mapped the appropriate options. In addition, we added a new librdkafka_options that enables transparent pass-through of librdkafka’s options.