I'm trying to run an mpi symmetric model on the host and mic architecture. Everything works fine as long as the total number of processes (mic+host) is less 10. But when it's greater than 10, I get the attached error.
This is my mpirun command:
mpirun -v -host p-linux -check-mpi -env I_MPI_DEBUG 5 -genv I_MPI_FABRICS shm:tcp -np 1 <host executable> : -host mic0 -iface mic0 -env I_MPI_DEBUG 5 -env LD_LIBRARY_PATH=/opt/intel/composer_xe_2013.5.192/compiler/lib/mic:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/opt/intel/composer_xe_2013.5.192/compiler/lib/mic:/opt/intel/composer_xe_2013.5.192/mkl/lib/mic:/opt/intel/composer_xe_2013.5.192/tbb/lib/mic -np 11 <mic executable>
Here the total number of processes is 11+1=12 which is greater than 10 and so I get the error. If it's less than 10 the program executes correctly.
I noticed that in the bottom part of the above error message, i.e. :
[proxy:0:1@p-linux-mic0] got pmi command (from 30): put
kvsname=kvs_9321_0 key=P10-businesscard-0 value=description#
there is no $port ... $ifname after the "value=description#" part, which is not the case for other processes.