From: Mike Marciniszyn Date: Fri, 23 May 2014 12:01:27 +0000 (-0400) Subject: Update qib/psm/qperf release notes for 3.12 X-Git-Url: https://openfabrics.org/gitweb/?a=commitdiff_plain;h=7a1b41fd0ff601b7f14e29a6d83dc74d4444b969;p=~aditr%2Fcompat-rdma-docs.git Update qib/psm/qperf release notes for 3.12 Signed-off-by: Mike Marciniszyn --- diff --git a/release_notes/psm_release_notes.txt b/release_notes/psm_release_notes.txt index b2b08e5..8fb9401 100644 --- a/release_notes/psm_release_notes.txt +++ b/release_notes/psm_release_notes.txt @@ -1,7 +1,7 @@ Open Fabrics Enterprise Distribution (OFED) - PSM in OFED 3.5 Release Notes + PSM in OFED 3.12 Release Notes - December 2012 + May 2014 ====================================================================== 1. Overview @@ -10,7 +10,7 @@ The Performance Scaled Messaging (PSM) API is Intel's low-level user-level communications interface for the Intel(R) True Scale Fabric family of products. -The PSM libraries are included in the infinipath-psm-3.1-364.1140_open.src.rpm +The PSM libraries are included in the infinipath-psm-3.2-2_ga8c3e3e_open.src.rpm source RPM and get built and installed as part of a default OFED install process. @@ -25,8 +25,8 @@ with PSM support are as follows: Open MPI: - Download a recent Open MPI tar ball from - http://www.open-mpi.org/software/ompi/v1.6/ . - Versions 1.6.1 & 1.6.3 has been tested with PSM from this OFED release. + http://www.open-mpi.org/software/ompi/v1.8/ . + Version 1.8.1 has been tested with PSM from this OFED release. - Untar the file and cd to the Open MPI directory. Then ./configure --with-psm --prefix= make @@ -36,14 +36,28 @@ MVAPICH2: - Download a recent MVAPICH2 tar ball from http://mvapich.cse.ohio-state.edu/download/mvapich2/ - Version 1.8.1 has been tested with PSM from this OFED release. -- Untar the file and go to the mvapich2-1.x.x directory + Version 1.9 has been tested with PSM from this OFED release. +- Untar the file and go to the mvapich2-1.x directory - Execute the configure and make commands as follows: ./configure --prefix= --with-device=ch3:psm \ --enable-shared make make install +Once these MPIs are built, using mpirun/mpiexec will result in the use +of PSM by default -- no additional options needed. Also if you have two +Intel True Scale HCAs per node, both of them will be used by default +when you run with 2 or more ranks per node. No option is necessary on +the mpirun/mpiexec command. + +If you want to use just one of the HCAs, set the IPATH_UNIT variable to: +export IPATH_UNIT=0 (or =1) +If you have two Intel True Scale HCAs per node, and want to get additional +bandwidth performance even when only one MPI rank is active per node, set: +export PSM_MULTIRAIL=0 +For most applications, it is better not to use this PSM_MULTIRAIL variable +since it increases MPI latency somewhat, but it is helpful for a minority +of applications that require additional bandwidth from single ranks. * To configure with a different compiler suite than the native GCC suite on your diff --git a/release_notes/qib_release_notes.txt b/release_notes/qib_release_notes.txt index 9cbbc31..079d270 100644 --- a/release_notes/qib_release_notes.txt +++ b/release_notes/qib_release_notes.txt @@ -1,7 +1,7 @@ Open Fabrics Enterprise Distribution (OFED) - qib in OFED 3.5 Release Notes + qib in OFED 3.12 Release Notes - December 2012 + May 2014 ====================================================================== 1. Overview @@ -20,7 +20,7 @@ Fabric HCAs, also known as QLogic TrueScale PCI-Express HCAs, including, - QLE7280 (x16 PCIe Gen1) -The qib driver has been updated for OFED 3.5. +The qib driver has been updated for OFED 3.12. The qib kernel driver obsoletes the ipath kernel driver but is compatible with libipathverbs so no new user level components are needed. diff --git a/release_notes/qperf_release_notes.txt b/release_notes/qperf_release_notes.txt index 28a5114..9a4588f 100644 --- a/release_notes/qperf_release_notes.txt +++ b/release_notes/qperf_release_notes.txt @@ -1,6 +1,7 @@ -Distribution - Open Fabrics Enterprise Distribution (OFED) 1.5, December 2009 + Open Fabrics Enterprise Distribution (OFED) + qperf in OFED 3.12 Release Notes + May 2014 Summary qperf - Measure RDMA and IP performance