get_world_size_and_rank

torchtune.training.get_world_size_and_rank() → Tuple[int, int]

Function that gets the current world size (aka total number of ranks) and rank number of the current process in the default process group.

Returns:

world size, rank

Return type:

Tuple[int, int]