TanhGate

class torchtune.modules.TanhGate

Implements a basic learnable gate to scale layer outputs

forward(x: Tensor) → Tensor

Parameters:

x (torch.Tensor) – input tensor to gate

Returns:

The output tensor after gating. Has the same shape as x.

Return type:

torch.Tensor