Shortcuts

Mish

class torch.nn.Mish(inplace=False)[source]

Applies the Mish function, element-wise.

Mish: A Self Regularized Non-Monotonic Neural Activation Function.

Mish(x)=xTanh(Softplus(x))\text{Mish}(x) = x * \text{Tanh}(\text{Softplus}(x))
Shape:
  • Input: ()(*), where * means any number of dimensions.

  • Output: ()(*), same shape as the input.

../_images/Mish.png

Examples:

>>> m = nn.Mish()
>>> input = torch.randn(2)
>>> output = m(input)

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources