Advanced Topics in HDF5

Topic	Description
Chunking in HDF5	Provides detailed information regarding chunking in HDF5
HDF5 File Image Operations (PDF)	Describes how to work with HDF5 files in memory. Disk I/O is not required when file images are opened, created, read from, or written to
Copying Committed Datatypes with H5Ocopy (PDF)	Describes how to copy to another file a dataset that uses a committed datatype or an object with an attribute that uses a committed datatype so that the committed datatype in the destination file can be used by multiple objects
Collective Metadata I/O	Describes optimizing HDF5 by collecting metadata I/O
Enabling a Strict Consistency Semantics Model in Parallel HDF5 (PDF)	Describes how to improve file access consistency semantics with the Parallel HDF5 library
File Space Management	Describes mechanisms to manage space in an HDF5 file
Fine-tuning the Metadata Cache	Describes how to provide better control of the metadata cache
Freeing Memory Allocated by the HDF5 Library (PDF)	Describes how inconsistent memory management can cause heap corruption or resource leaks and possible solutions
HDF5 Data Flow Pipeline for H5Dread	Describes data flow when reading raw data from an HDF5 dataset
HDF5 Metadata	Provides a comprehensive overview of the types of metadata used in HDF5
Introduction to Single-Writer_Multiple-Reader (SWMR)	Enables writing to a file while multiple readers are accessing it
Introduction to the Virtual Dataset - VDS	Describes how to present data stored in several HDF5 datasets and files as a single dataset and access the data using HDF5 APIs
Modified Region Writes (PDF)	Describes how to set write operations for in-memory files so that only modified regions are written to storage. Available when the Core (Memory) VFD is used
Page Buffering (PDF)	Describes how to reduce the number of small accesses in HDF5 by buffering metadata and raw data accesses
Partial Edge Chunks	Describes how to control the filtering of partial edge chunks to improve performance when extending datasets
Thread-safe HDF5	Information on thread-safety and concurrent access in HDF5
Using the Direct Chunk Write Function (PDF)	Describes another way that chunks can be written to datasets
Virtual Object Layer	An abstraction layer within the HDF5 library that enables different methods for accessing data and objects that conform to the HDF5 data model