Problems with 512 cores or more.

Problems with 512 cores or more.

Adalberto Fazzio's picture
Adalberto Fazzio
Sun, 01/29/2012 - 14:21

Hello all! When I try to run an application with 512 cores (or more) I get this MPI error: [33] MPI startup(): ofa fabric is not available and fallback fabric is not enabled

I'm usingI_MPI_FABRICS=shm:ofa, but with DAPL I also get an MPI error. Using 256 cores or less I got no errors, it works like a charm. The system is a SGI cluster with quad-socket AMD Interlagos nodes (64 cores per node). Each node as two Infiniband ports and theI_MPI_OFA_NUM_PORTS=2 is enabled. Thank you in advance!

RSS Top
2 posts / 0 new
Last post
For more complete information about compiler optimizations, see our Optimization Notice.
Dmitry Kuzmin (Intel)'s picture
Dmitry Kuzmin (Intel)
Mon, 01/30/2012 - 21:58

Hi Adalberto,

To answer your question we need to get more information.
Could you please provide the command line and environment variables you set before mpirun.
Add "-env I_MPI_DEBUG 6" to the command line and send us the output (you can send a private message if don't want to share your information with all readers - see option "mark this post private" below).

Regards!
Dmitry

Top

Login to leave a comment.