init_distributed

torchtune.utils.init_distributed(**kwargs: Dict[str, Any]) → bool

Initialize process group required for torch.distributed.

Parameters:

**kwargs (Dict) – Additional arguments to pass to torch.distributed.init_process_group.

Returns:

True if torch.distributed is initialized.

Return type:

bool

Raises:

RuntimeError – If torch.distributed is already initialized.