
Ben / Jan 31st, 2021 /
Improved `file` source checkpointing
The `file` source checkpointing strategy has been improved to solve surprising edge cases.
The Vector file
source included an option called start_at_beginning
that would determine where
Vector would begin reading a file based on a variety of conditions. As you can see, these conditions were
quite confusing. To resolve this, PR 6178 deprecated the start_at_beginning
option and replaced it with new
ignore_checkpoints
and read_from
options. Migrating is easy:
[sources.file]type = "file"-start_at_beginning = true+ignore_checkpoints = false # default+read_from = "beginning" # default
Adjust as necessary. The above values are the defaults and are not required to be specified.
This change was made available in 0.12.0. You can get this change by downloading the latest stable release.