The forward exponential linear unit layer [Clevert2016] computes the value of the following function

for the input argument , where is the user-defined coefficient.

Problem Statement

Let be the tensor of the order p that contains the input data from the preceding layer. The problem is to compute the resulting tensor with the components

for all

Orange (only for download buttons)