[ 参数不一致 ]torch.nn.functional.batch_norm

torch.nn.functional.batch_norm

torch.nn.functional.batch_norm(input, running_mean, running_var, weight=None, bias=None, training=False, momentum=0.1, eps=1e-05)

paddle.nn.functional.batch_norm

paddle.nn.functional.batch_norm(x, running_mean, running_var, weight, bias, training=False, momentum=0.9, epsilon=1e-05, data_format='NCHW', name=None)

其中 Pytorch 与 Paddle 参数不一致,具体如下:

参数映射

| PyTorch | PaddlePaddle | 备注 | | ————- | ———— | —————————————————— | | input | x | 表示输入的 Tensor ,仅参数名不一致。 | | running_mean | running_mean | 均值的 Tensor。 | | running_var | running_var | 方差的 Tensor。 | | weight | weight | 权重的 Tensor。 | | bias | bias | 偏置的 Tensor。 | | eps | epsilon | 为了数值稳定加在分母上的值。 | | momentum | momentum | 此值用于计算 moving_mean 和 moving_var, 值的大小 Paddle = 1 - Pytorch,需要转写。 | | training | training | 是否可训练。 | | - | data_format | 指定输入数据格式,Pytorch 无此参数,Paddle 保持默认即可。 |

转写示例

momentum:此值用于计算 moving_mean 和 moving_var

# Pytorch 写法
torch.nn.functional.batch_norm(input=input, running_mean=running_mean, running_var=running_var, momentum=0.1)

# Paddle 写法
paddle.nn.functional.batch_norm(x=input, running_mean=running_mean, running_var=running_var, momentum=0.9)