Intel® MPI Library

利用英特尔® Nervana™ 技术、neon* 和 Pachyderm* 实施 Docker* 化的分布式深度学习

机器学习和人工智能领域的最新进步令人惊叹!几乎每天都会出现新的突破性进展,从自动驾驶汽车到人工智能学习复杂的游戏。为了给公司带来真正的价值,数据科学家必须在公司的数据管线和基础设施上部署模型,不能仅限于在电脑上展示模型。

此外,数据科学家应该在改善机器学习应用上投入更多的精力,他们不需要花大量的时间手动更新应用,以应对不断变化的生产数据;也不需要在追溯和跟踪反常的过往行为中浪费时间。

Docker*Pachyderm* 有助于数据科学家在生产集群上创建、部署和更新机器学习应用,在大数据集之间分配处理以及在数据管线中跟踪输入和输出数据。本文将展示如何利用英特尔® Nervana™ 技术、neon* 和 Pachyderm设置生产就绪型机器学习工作流程。

  • Студенты
  • Искусственный интеллект (AI)
  • Python*
  • Средний
  • Библиотека Intel® Data Analytics Acceleration Library (Intel® DAAL)
  • Дистрибутивный комплект Intel® для Python*
  • Библиотека Intel® Math Kernel Library
  • Intel® MPI Library
  • Компоненты Intel® Threading Building Blocks
  • Neon*
  • Pachyderm*
  • Большие объемы данных
  • Машинное обучение
  • Intel® MPI Library 2018 Beta - Documentation

    The section below provides links to the Intel® MPI Library 2018 Beta documentation. You can find other documentation, including user guides and reference manuals for current and earlier Intel software product releases in the Intel® Software Documentation Library.

    Visit this page for documentation pertaining to the latest stable Intel MPI Library release.

  • Intel® MPI Library
  • Introduction

    The Intel® MPI Library Developer Guide explains how to use the Intel® MPI Library in some common usage scenarios. It provides information regarding compiling, running, debugging, tuning and analyzing MPI applications, as well as troubleshooting information.

    Cross-OS Launch Mode

    Intel® MPI Library provides support for the heterogeneous Windows*-Linux* environment. This means that you can run MPI programs on nodes that operate on Windows and Linux OS as single MPI jobs, using the Hydra process manager.

    To run a mixed Linux-Windows MPI job, do the following:

    1. Make sure the Intel MPI Library is installed and operable, and the product versions match on all nodes.

    2. On the Windows hosts, make sure the Hydra service is running:

    Cluster Specific Tuning

    The cluster specific mode is intended for tuning Intel® MPI Library for a specific cluster. For finding optimal settings, mpitune uses a benchmarking program: it runs tests several times with different parameters and searches for the best ones. By default, Intel® MPI Benchmarks are used.

    To tune Intel MPI Library in the cluster specific mode, do the following:

    Installing Intel® MPI Library

    If you have a previous version of the Intel® MPI Library for Windows* OS installed, you do not need to uninstall it before installing a newer version.

    To install Intel MPI Library, double-click on the distribution file w_mpi_p_<version>.<package_num>.exe (complete product), and w_mpi-rt_p_<version>.<package_num>.exe (RTO component only).

    Подписаться на Intel® MPI Library