Skip to content

partitions

Retrieves metadata about events stored at a node.

partitions [predicate:expr]

The partitions operator shows a summary of candidate partitions at a node.

Show only partitions which would be considered for pipelines of the form export | where <expr> instead of returning all data.

Tenzir emits partition information with the following schema:

Contains detailed information about a partition.

FieldTypeDescription
uuidstringThe unique ID of the partition in the UUIDv4 format.
memusageuint64The memory usage of the partition in bytes.
diskusageuint64The disk usage of the partition in bytes.
eventsuint64The number of events contained in the partition.
min_import_timetimeThe time at which the first event of the partition arrived at the import operator.
max_import_timetimeThe time at which the last event of the partition arrived at the import operator.
versionuint64The version number of the internal partition storage format.
schemastringThe schema name of the events contained in the partition.
schema_idstringA unique identifier for the physical layout of the partition.
storerecordResource information about the partition’s store.
indexesrecordResource information about the partition’s indexes.
sketchesrecordResource information about the partition’s sketches.

The records store, indexes, and sketches have the following schema:

FieldTypeDescription
urlstringThe URL of the resource.
sizeuint64The size of the resource.

Get memory and disk requirements of all stored data

Section titled “Get memory and disk requirements of all stored data”
partitions
summarize schema,
events=sum(events),
diskusage=sum(diskusage),
memusage=sum(memusage)
sort schema

Get an upper bound of events that have a field src_ip with 127.0.0.1

Section titled “Get an upper bound of events that have a field src_ip with 127.0.0.1”
partitions src_ip == 127.0.0.1
summarize candidates=sum(events)

See how many partitions contain a non-null value for the field hostname

Section titled “See how many partitions contain a non-null value for the field hostname”
partitions hostname != null