/ Feb 24th, 2020 /

Log Data Model Changes & Disk Buffers

We're bringing our log data model closer to JSON

We are currently working to improve and optimize our log data model. Initial versions of this data model were represented as a flat map for key access optimizations. This proved over time to not be as helpful as we had hoped. As a result we are working to move our data model to be as close to JSON as possible. This means:

  1. null values are now supported in Vector's data model.
  2. Nested fields are represented in an actual nested representation.

Both of these changes bring Vector's internal data model closer to JSON. Unfortunately, this breaks disk buffer serialization which means you must drain your disk buffer before upgrading Vector.

Upgrade Guide

  1. Make sure Vector shuts down normally to ensure your disk buffers are fully drained.
  2. That's it! Update Vector as usual.

Note, Vector will discard invalid disk buffer data, bad data will not prevent Vector from starting.

This change was made available in 0.8.0. You can get this change by downloading the latest stable release.

Like What You See?