I installed mpss 3.3 with ofed 220.127.116.11 on my 5110p based server. IB is mlx_4. Node IB is working fine. I am able to login to a remote xeon phi using external bridging support. I am running these services: mpss, openibd, ofed-mic, and mpxyd. I am still not able to access xeon phi over IB (not even on same node).
I have configured ipoib.conf to set the ip of xeon phi to be on the same network as my other nodes. What could be the problem?
No problem connecting xeon phis within single node using scif. Some how i am not able to utilize ccl.
OS: RHEL 6.3
HCA Driver: mlx_4
MPSS: 3.3 gold update
Xeon phi ROM: updated
Hardware: Supermicro with intel xeon e5 processor with Mellanox HBA