Developer Guide

Contents

Two-Dimensional Stochastic Pooling Backward Layer

At the training stage, the forward two-dimensional (2D) stochastic pooling layer is a form of non-linear downsampling of an input tensor
X
R
n
1
x
n
2
x ... x
n
p
with non-negative elements
x
i
1
...
i
p
. The layer partitions the input tensor data into 2D subtensors along dimensions
k
1
and
k
2
and selects an element in each subtensor using sampling from a multinomial distribution. Probabilities required in the distribution are calculated by normalizing the subtensor. In the output, the selected element replaces the entire subtensor. For more details, see Forward 2D Stochastic Pooling Layer.
The backward 2D stochastic pooling layer computes the derivatives of the objective function
E
as the sum of input gradients that correspond to the elements pooled from subtensors in the forward step.

Problem Statement

Given:
  • The tensor
    G
    R
    l
    1
    x ... x
    l
    p
    with the input gradient
  • Dimensions
    k
    1
    and
    k
    2
    along which kernels are applied
  • Kernel sizes
    m
    1
    and
    m
    2
    :
    where
    p
    1
    and
    p
    2
    are paddings
The problem is to compute the value tensor
Z
R
n
1
x ... x
n
p
as follows:
where:
  • s
    1
    and
    s
    2
    are strides

Product and Performance Information

1

Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.

Notice revision #20110804