Utility Functions

DataPipe Graph Visualization

to_graph

Visualizes a DataPipe by returning a graphviz.Digraph, which is a graph of the data pipeline.

Common Utility Functions

janitor	Invokes various obj cleanup procedures such as: - Closing streams
pin_memory_fn	Utility function to move data to pinned memory.

File Object and Stream Utility

StreamWrapper

StreamWrapper is introduced to wrap file handler generated by DataPipe operation like FileOpener.

DataLoader

For documentation related to DataLoader, please refer to the torch.utils.data documentation. Or, more specifically, the DataLoader API section.

DataLoader v2 is currently in development. For more information please refer to DataLoader2.

Sampler

For documentation related to Sampler, please refer to the torch.utils.data documentation on Data Loading order. The Sampler API section is here.