SmoothReLU Forward Layer

The forward smooth rectifier linear unit (SmoothReLU) layer computes the function f(x) = log(1 + exp(x)) for the input argument x.

Problem Statement

Given a p-dimensional tensor X of size n 1 x n 2 x ... x n p , the problem is to compute the p-dimensional tensor Y = (y i 1...i p ) of size n 1 x n 2 x ... x n p such that:

For more complete information about compiler optimizations, see our Optimization Notice.
Select sticky button color: 
Orange (only for download buttons)