liveBook · Manning

XOR compression

As explained in Cloud Observability in Action

XOR compression is a compression technique that uses bitwise exclusive-or differences between values to encode related data compactly.

XOR compression stores related values compactly by applying bitwise exclusive-or differences. In continuous profiling, backends use it to minimize timestamp storage, much like delta-of-delta encoding. section 9.3.2

Profile timestamp storage

A profiling backend can combine XOR compression with columnar storage to reduce the footprint of large collections of profile timestamps. The technique originates in the Gorilla time-series database work and is used alongside storage systems such as FrostDB. section 9.3.2 section 5.5

How Cloud Observability in Action covers it

How deep it goes
Explains XOR compression as delta-of-delta encoding for timestamps, but omits encoding and decoding steps.
Examples
Uses profiling backends, Parca’s FrostDB, Apache Parquet, Apache Arrow, and the Gorilla time-series database as context.
What you can do after
Evaluate how timestamp compression can reduce storage footprints in profiling and observability systems.
How it connects
Connects continuous profiling with timestamps, columnar storage, differential storage, and time-series databases.
Cover of Cloud Observability in Action
liveBookmanning.com
Read Cloud Observability in Action on liveBook Get the book at manning.com

This explainer was generated by Manning's knowledge graph from the text of Cloud Observability in Action. The section links point to the parts of the book it draws on.