SELU¶

class paddle.nn. SELU ( scale=1.0507009873554805, alpha=1.6732632423543772, name=None ) [source]

SELU Activation

\[\begin{split}SELU(x)= scale * \left\{ \begin{array}{lcl} x,& &\text{if } \ x > 0 \\ alpha * e^{x} - alpha,& &\text{if } \ x <= 0 \end{array} \right.\end{split}\]

Parameters

scale (float, optional) – The value of scale(must be greater than 1.0) for SELU. Default is 1.0507009873554804934193349852946.
alpha (float, optional) – The value of alpha(must be no less than zero) for SELU. Default is 1.6732632423543772848170429916717.
name (str, optional) – Name for the operation (optional, default is None). For more information, please refer to Name.

Shape:

input: Tensor with any shape.
output: Tensor with the same shape as input.

Examples

           >>> import paddle

>>> x = paddle.to_tensor([[0.0, 1.0],[2.0, 3.0]])
>>> m = paddle.nn.SELU()
>>> out = m(x)
>>> print(out)
Tensor(shape=[2, 2], dtype=float32, place=Place(cpu), stop_gradient=True,
[[0.        , 1.05070102],
 [2.10140204, 3.15210295]])

          

forward ( x ) forward¶

Defines the computation performed at every call. Should be overridden by all subclasses.

Parameters

*inputs (tuple) – unpacked tuple arguments
**kwargs (dict) – unpacked dict arguments

extra_repr ( ) extra_repr¶: Extra representation of this layer, you can have custom implementation of your own layer.

SELU¶

forward¶

extra_repr¶