Table of Contents

Shortcuts

get_world_size_and_rank¶

torchtune.utils.get_world_size_and_rank() → Tuple[int, int][source]¶

Function that gets the current world size (aka total number of ranks) and rank number of the current trainer.

Returns:: world size, rank
Return type:: Tuple[int, int]

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources