legate.io.hdf5.kerchunk_read#

legate.io.hdf5.kerchunk_read(filepath: Path | str, dataset_name: str) → LogicalArray#

Read an HDF5 array from disk using Kerchunk and KvikIO.

We use Kerchunk’s SingleHdf5ToZarr to find the data chunks embedded in the hdf5 file. If it fails for any reason, this function fails as well.

Notes

The returned array might be a view of an underlying array that has been padded in order to make its shape divisible by the shape of the hdf5 chunks on disk.

Parameters:

  • filepath – File path to the hdf5 file.

  • dataset_name – Name/path of the dataset. This must reference a single array, thus make sure to use the full path to the array inside the HDF5 file.

Return type:

The Legate array read from disk.

On this page