dbd0e39204953df048ea90992a90a07caefa025f,pro_gan_pytorch/CustomLayers.py,PixelwiseNorm,forward,#PixelwiseNorm#,146

Before Change

        :param alpha: small number for numerical stability
        :return: y => pixel normalized activations
        
        y = th.mean(x.pow(2.), dim=1, keepdim=True) + alpha  // [N1HW]
        return x.div(y.sqrt())

After Change

        :param alpha: small number for numerical stability
        :return: y => pixel normalized activations
        
        y = x.pow(2.).mean(dim=1, keepdim=True).add(alpha).sqrt()  // [N1HW]
        y = x / y  // normalize the input x volume
        return y

Instances