Getting Started Guide

Contents

Truncated Gaussian Initializer

A truncated Gaussian initializer is an initializer algorithm to initialize a
p
-dimensional tensor
X
R
n
1
x ... x
n
p
with variates that have the Gaussian probability density function with mean
μ
and standard deviation
σ
and belong to the truncation range [
a
,
b
], where
b
>
a
,
μ
,
σ
R
, and
σ
> 0.
The bounds of the truncation range define the following cases:
  • No truncation:
    a
    = -
    ,
    b
    = +
  • Left truncation:
    a
    > -
    ,
    b
    = +
  • Right truncation:
    a
    = -
    ,
    b
    < +
  • Two-sided truncation:
    a
    > -
    ,
    b
    < +

Algorithm Parameters

In addition to common parameters of the initializer interface, a truncated Gaussian initializer has the following parameters:
Parameter
Default Value
Description
algorithmFPType
float
The floating-point type that the algorithm uses for intermediate computations. Can be
float
or
double
.
method
defaultDense
Inverse cumulative distribution function (CDF) transform method. Performance-oriented computation method, the only method supported by the algorithm.
mean
0
The mean
μ
.
sigma
1
The standard deviation
σ
.
a
mean
- 2*
sigma
The left bound of the truncation range. If it is set to the negative infinity, there is no left truncation.
b
mean
+ 2*
sigma
The right bound of the truncation range. If it is set to the positive infinity, there is no right truncation.
1

Product and Performance Information

1

Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reservered for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.

Notice revision #20110804