pReLU Forward Layer

The forward parametric rectifier linear unit (pReLU) layer computes the function f(x) = max(0, x) + w * min(0, x) for the input argument x, where w is the weight of this argument [HeZhangRenSun].

Problem Statement

Given p-dimensional tensors X and W of size n 1 x n 2 x ... x n p , the problem is to compute the p-dimensional tensor Y = (y i 1...i p ) of size n 1 x n 2 x ... x n p such that:

For more complete information about compiler optimizations, see our Optimization Notice.
Select sticky button color: 
Orange (only for download buttons)