quantlab.backend.zarr#

The Zarr storage backend: xarray panels persisted as Zarr stores.

XrBackend is the backend every dataset, factor and model object in the pipeline owns by default. It keeps an xarray.Dataset in memory, persists it as a Zarr store, and carries the machinery chunked ingestion needs to grow a store safely over time: append extends the time axis with a set of corruption checks that raw to_zarr(mode="a") does not perform, and the widen_* family reconciles a store whose symbol roster or variable set has grown between runs. It implements DataBackend from quantlab.backend.base; the lazy Parquet counterpart for long-format reference tables is quantlab.backend.parquet.PlBackend. See docs/user-guide/datasets.md and docs/user-guide/datasets.md.

Classes

XrBackend

Zarr-backed storage for an xarray.Dataset panel.

Functions

rechunk_index_coordinates

Rewrite each 1-D index coordinate of a store in one chunk, in place.