Intel® MPI Library

利用英特尔® Nervana™ 技术、neon* 和 Pachyderm* 实施 Docker* 化的分布式深度学习



Docker*Pachyderm* 有助于数据科学家在生产集群上创建、部署和更新机器学习应用,在大数据集之间分配处理以及在数据管线中跟踪输入和输出数据。本文将展示如何利用英特尔® Nervana™ 技术、neon* 和 Pachyderm设置生产就绪型机器学习工作流程。

  • Students
  • Artificial Intelligence
  • Python*
  • Intermediate
  • Intel® Data Analytics Acceleration Library (Intel® DAAL)
  • Intel® Distribution for Python*
  • Intel® Math Kernel Library
  • Intel® MPI Library
  • Intel® Threading Building Blocks
  • Neon*
  • Pachyderm*
  • Big Data
  • Machine Learning
  • Intel® MPI Library 2018 Beta - Documentation

    The section below provides links to the Intel® MPI Library 2018 Beta documentation. You can find other documentation, including user guides and reference manuals for current and earlier Intel software product releases in the Intel® Software Documentation Library.

    Visit this page for documentation pertaining to the latest stable Intel MPI Library release.

  • Intel® MPI Library
  • Introduction

    The Intel® MPI Library Developer Guide explains how to use the Intel® MPI Library in some common usage scenarios. It provides information regarding compiling, running, debugging, tuning and analyzing MPI applications, as well as troubleshooting information.

    Cross-OS Launch Mode

    Intel® MPI Library provides support for the heterogeneous Windows*-Linux* environment. This means that you can run MPI programs on nodes that operate on Windows and Linux OS as single MPI jobs, using the Hydra process manager.

    To run a mixed Linux-Windows MPI job, do the following:

    1. Make sure the Intel MPI Library is installed and operable, and the product versions match on all nodes.

    2. On the Windows hosts, make sure the Hydra service is running:

    Cluster Specific Tuning

    The cluster specific mode is intended for tuning Intel® MPI Library for a specific cluster. For finding optimal settings, mpitune uses a benchmarking program: it runs tests several times with different parameters and searches for the best ones. By default, Intel® MPI Benchmarks are used.

    To tune Intel MPI Library in the cluster specific mode, do the following:

    Installing Intel® MPI Library

    If you have a previous version of the Intel® MPI Library for Windows* OS installed, you do not need to uninstall it before installing a newer version.

    To install Intel MPI Library, double-click on the distribution file w_mpi_p_<version>.<package_num>.exe (complete product), and w_mpi-rt_p_<version>.<package_num>.exe (RTO component only).

    Subscribe to Intel® MPI Library