Spark* samples for the Intel® Data Analytics Acceleration Library (Intel® DAAL) are designed to show how to use this library on the Spark cluster in a Java application.
Unzip the archive with Intel® DAAL samples to your working directory (<sample_dir>).
You can use Intel® DAAL Spark samples on Linux* and macOS* operating systems. For a list of Intel® DAAL hardware and software requirements, refer to release notes for the version of Intel® DAAL you are using.
Note: Intel® DAAL is expected to work on many more Spark distributions as well. Let us know if you have any troubles with the distribution you are using.
Before you build the sample, you must set certain environment variables that define the location of related libraries. The Intel® DAAL includes the daalvars scripts that you can run to set environment variables:
For more information about setting environment variables and configuring Intel® DAAL, refer to Getting Started guides for the library.
To build Intel® DAAL Spark Java samples, go to the Java Spark samples directory:
cd <sample_dir>/java/spark
Execute the ./launcher.sh {ia32|intel64} script to run the following algorithms on your Spark cluster:
You can manage the list of running samples by changing the Spark_samples_list variable in the ./launcher.sh script.
From the {ia32|intel64} parameters, select the one that matches the architecture parameter you provided to the daalvars.sh script. If no parameters are defined for the make command, the Intel® 64 architecture is used by default.
For each algorithm, the results are stored in the /_results/<sample_name>/<sample_name>.res file.
Intel, and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.
*Other names and brands may be claimed as the property of others.
© Copyright 2017, Intel Corporation
Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice. Notice revision #20110804 |