MultiReferenceFileSystem

An fsspec filesystem that extends Kerchunk’s ReferenceFileSystem with multi-range byte fetching. This is used internally by the Zarr codec pipeline to read JPEG 2000 codestreams with interleaved tile-parts that span non-contiguous byte ranges in a single file.

Note

fsspec is an optional dependency. This class is available when pip install osml-imagery-io[zarr] is installed.

class aws.osml.io.multi_reference_fs.MultiReferenceFileSystem(*args, **kwargs)

Bases: ReferenceFileSystem

ReferenceFileSystem with multi-range chunk support.

Extends the Kerchunk reference spec to support a fourth reference form:

["url", [[offset, length], [offset, length], ...]]

for chunks whose data spans multiple non-contiguous byte ranges.

All existing reference forms (inline, whole-file, single-range) are handled by the parent class unchanged.