.. role:: hidden
    :class: hidden-section

Distributed Optimizers
======================

.. warning ::
    Distributed optimizer is not currently supported when using CUDA tensors

.. automodule:: torch.distributed.optim
    :members: DistributedOptimizer, PostLocalSGDOptimizer, ZeroRedundancyOptimizer