Developer Guide for Intel® Data Analytics Acceleration Library 2017 Update 3

Smooth Rectifier Linear Unit (SmoothReLU) Forward Layer

The forward smooth rectifier linear unit (SmoothReLU) layer computes the function f(x) = log(1 + exp(x)) for the input argument x.

Problem Statement

Given a p-dimensional tensor X of size n 1 x n 2 x ... x n p , the problem is to compute the p-dimensional tensor Y = (y i 1 ...i p ) of size n 1 x n 2 x ... x n p such that: