Silu¶
- class paddle.nn. Silu ( name=None ) [source]
-
Silu Activation. .. math:
Silu(x) =
rac{x}{1 + e^{-x}}
- Parameters:
-
x (Tensor): The input Tensor with data type float32, or float64. name (str, optional): Name for the operation (optional, default is None).
For more information, please refer to Name.
- Shape:
-
input: Tensor with any shape.
output: Tensor with the same shape as input.
- Examples:
-
import paddle x = paddle.to_tensor([1.0, 2.0, 3.0, 4.0]) m = paddle.nn.Silu() out = m(x) # [ 0.731059, 1.761594, 2.857722, 3.928055 ]
-
forward
(
x
)
forward¶
-
Defines the computation performed at every call. Should be overridden by all subclasses.
- Parameters
-
*inputs (tuple) – unpacked tuple arguments
**kwargs (dict) – unpacked dict arguments
-
extra_repr
(
)
extra_repr¶
-
Extra representation of this layer, you can have custom implementation of your own layer.