I am confused about OFED and True Scale adapter support in RHEL 6.5. Section 2.2 of the Users Guide says that native Phi applications running on True Scale systems are only supported through 6.3, but later on that same page it says that Infiniband support for RHEL 6.5 is provided by the distribution packages. What is special about 6.5 that it is singled out there? I can get non-phi applications to use Infiniband using the distribution packages in any recent version of RHEL. If there is something relevant to MPSS/Phi then what is it and how do I configure it?
More generally I am trying to figure out how to get all the modes of operation working for our Phi cards and have been running into problems, mostly with native application trying to use MPI. Our compute only nodes have Mellanox cards and we have Mellanox switches, but the Phi nodes that we got came with Qlogic cards that need the ib_qib hardware driver. Using the RHEL 6.5 provided driver we haven't been able to get MPI on the cards to talk to the host or other cards and compiling the MPSS ofed drivers doesn't include the ib_qib module. Can we make this work or do I need to move back to a 6.3 kernel? Also, Is this incompatibility going to be fixed in MPSS any time soon and how would we monitor the status of these kinds of bugs?