silu¶

paddle.nn.functional. silu ( x, name=None ) [source]

silu activation

\[silu(x) = \frac{x}{1 + e^{-x}}\]

Where \(x\) is the input Tensor.

Parameters

• x (Tensor) – The input Tensor with data type bfloat16, float16, float32, float64, complex64, complex128.

• name (str, optional) – For details, please refer to Name. Generally, no setting is required. Default: None.

Returns

A Tensor with the same data type and shape as x.

Examples

>>> import paddle
>>> import paddle.nn.functional as F

>>> x = paddle.to_tensor([1.0, 2.0, 3.0, 4.0])
>>> out = F.silu(x)
>>> print(out)
Tensor(shape=[4], dtype=float32, place=Place(cpu), stop_gradient=True,
[0.73105860, 1.76159406, 2.85772228, 3.92805505])