Sink options have been refactored
We’ve simplified and organized our sink options
In our preparation for 1.0 we took time to organize and cleanup our request-based sink options. The specific changes include:
request_*
options have been moved under arequest
table.retry_backoff_secs
must also be replaced with two new fieldsretry_initial_backoff_secs
andretry_max_duration_secs
.batch_*
options have been moved under abatch
table.batch_size
has been replaced with eitherbatch.max_events
orbatch.max_size
in order to clarify its purpose (capping discrete events or bytes respectively).basic_auth
fields have been moved to a general purposeauth
table complemented with astrategy
field.
These changes effect the following sinks:
aws_cloudwatch_logs
aws_kinesis_firehose
aws_kinesis_streams
aws_s3
clickhouse
datadog_metrics
elasticsearch
gcp_pubsub
http
new_relic_logs
splunk_hec
Upgrade Guide
[sinks.my_sink_id]
type = "http"
inputs = ["my-source-id"]
uri = "https://10.22.212.22:9000/endpoint"
- batch_size = 1049000
+ [sinks.my_sink_id.batch]
+ max_size = 1049000
- [sinks.my_sink_id.basic_auth]
+ [sinks.my_sink_id.auth]
+ strategy = "basic"
user = "${USERNAME_ENV_VAR}"
password = "${PASSWORD_ENV_VAR}"
- request_in_flight_limit = 5
- request_retry_backoff_secs = 1
+ [sinks.my_sink_id.request]
+ in_flight_limit = 5
+ retry_initial_backoff_secs = 1
+ retry_max_duration_secs = 10