From 8ccd35bfdee096e1b005c0faa887b5ecc0443421 Mon Sep 17 00:00:00 2001 From: Tatyana Nikolova Date: Tue, 29 Nov 2011 15:11:31 -0600 Subject: [PATCH] RDMA/nes: Update nes release notes Update nes_release_notes.txt file Signed-off-by: Jakub Fedoruk Signed-off-by: Tatyana Nikolova --- release_notes/nes_release_notes.txt | 92 ++++++++++------------------- 1 file changed, 31 insertions(+), 61 deletions(-) diff --git a/release_notes/nes_release_notes.txt b/release_notes/nes_release_notes.txt index 73628e2..6033895 100644 --- a/release_notes/nes_release_notes.txt +++ b/release_notes/nes_release_notes.txt @@ -1,6 +1,6 @@ Open Fabrics Enterprise Distribution (OFED) NetEffect Ethernet Cluster Server Adapter Release Notes - February 2011 + November 2011 @@ -10,20 +10,17 @@ support for the NetEffect Ethernet Cluster Server Adapters. ========== What's New ========== -OFED 1.5.3 contains several enhancements and bug fixes to iw_nes driver. - -* Correct AEQE operation. -* Add backports for 2.6.35 and 2.6.36 kernels. -* Fix for problem of lack of HW limit checking for MG attach for IMA. -* Fix for a problem with non-aligned buffers crash during post_recv for IMA. -* Fix for possible crash when RAW QP resources are destroyed. -* Fix for problem of RAW QP transition state to ERR. -* Fix a problem with sending packets with VLAN flag for IMA. -* Enable bonds on iw_nes. -* Fix hazard of sending ibevent for unregistered device. -* Fix for sending IB_EVENT_PORT_ERR/PORT_ACTIVE event on link state interrupt. -* Fix SFP link down detection issue with switch port disable. -* Fix incorrect SFP link status detection on driver init. +OFED 1.5.4 contains several enhancements and bug fixes to iw_nes driver. + +* Added backports for 2.6.35 to 3.0 kernels. +* Fixed a couple of problems which caused IMA to crash. +* Fixed a problem with VLAN flag for IMA. +* Enabled bonding with iw_nes. +* Fixed a couple of IB_EVENT issues. +* Fixed an SFP+ link status issue. +* Added support for Chelsio Interoperability. +* Added support for MPA version 2. + ============================================ Required Setting - RDMA Unify TCP port space @@ -47,14 +44,14 @@ If possible, disable Active State Power Management in the BIOS, e.g.: Loadable Module Options ======================= The following options can be used when loading the iw_nes module by modifying -modprobe.conf file. +/etc/modprobe.conf file. wide_ppm_offset=0 Set to 1 will increase CX4 interface clock ppm offset to 300ppm. Default setting 0 is 100ppm. mpa_version=1 - MPA version to be used int MPA Req/Resp (0 or 1). + MPA version to be used int MPA Req/Resp (1 or 2). disable_mpa_crc=0 Disable checking of MPA CRC. @@ -109,11 +106,16 @@ NOTE: Assuming NetEffect Ethernet Cluster Server Adapter is assigned eth2. =================== uDAPL Configuration =================== -Rest of the document assumes the following uDAPL settings in dat.conf: +Rest of the document assumes the following uDAPL settings in /etc/dat.conf: OpenIB-iwarp u1.2 nonthreadsafe default libdaplcma.so.1 dapl.1.2 "eth2 0" "" ofa-v2-iwarp u2.0 nonthreadsafe default libdaplofa.so.2 dapl.2.0 "eth2 0" "" +======================== +Chelsio Interoperability +======================== +The firmware version supporting interoperability with Chelsio is 3.23 or greater. +The load time Chelsio parameter peer2peer must be set to 1. ============== mpd.hosts file @@ -130,63 +132,35 @@ This operational mode can cause 100% CPU utilization. To switch to Event Driven mode and lower CPU utilization please refer to README or Release Notes for specific application. -============================================================ -Recommended Settings for Platform MPI 7.1 (formerly HP-MPI) -============================================================ -Add the following to mpirun command: - - -1sided - -Example mpirun command with uDAPL-2.0: - - mpirun -np 2 -hostfile /opt/mpd.hosts - -UDAPL -prot -intra=shm - -e MPI_HASIC_UDAPL=ofa-v2-iwarp - -1sided - /opt/platform_mpi/help/hello_world - -Example mpirun command with uDAPL-1.2: - - mpirun -np 2 -hostfile /opt/mpd.hosts - -UDAPL -prot -intra=shm - -e MPI_HASIC_UDAPL=OpenIB-iwarp - -1sided - /opt/platform_mpi/help/hello_world - - ============================================== Recommended Settings for Intel MPI 4.0.x ============================================== Add the following to mpiexec command: -genv I_MPI_FALLBACK_DEVICE 0 - -genv I_MPI_FABRICS shm:dapl - -genv I_MPI_DAPL_PROVIDER ofa-v2-iwarp + -genv I_MPI_DEVICE rdma:ofa-v2-iwarp -genv I_MPI_USE_RENDEZVOUS_RDMA_WRITE 1 Example mpiexec command line for uDAPL-2.0: mpiexec -genv I_MPI_FALLBACK_DEVICE 0 - -genv I_MPI_DEVICE shm:dapl - -genv I_MPI_DAPL_PROVIDER OpenIB-iwarp - -genv I_MPI_DAPL_PROVIDER ofa-v2-iwarp + -genv I_MPI_DEVICE rdma:ofa-v2-iwarp -genv I_MPI_USE_RENDEZVOUS_RDMA_WRITE 1 -ppn 1 -n 2 /opt/intel/impi/4.0.0.025/bin64/IMB-MPI1 -Intel MPI use CQ Polling mode as a default. -To switch to wait mode add the following to mpiexec command: - -genv I_MPI_WAIT_MODE 1 - -NOTE: Wait mode supports the sock device only. - Example mpiexec command line for uDAPL-1.2: mpiexec -genv I_MPI_FALLBACK_DEVICE 0 -genv I_MPI_DEVICE rdma:OpenIB-iwarp -genv I_MPI_USE_RENDEZVOUS_RDMA_WRITE 1 -ppn 1 -n 2 - /opt/intel/impi/3.2.2/bin64/IMB-MPI1 + /opt/intel/impi/4.0.0.025/bin64/IMB-MPI1 + +Intel MPI use CQ Polling mode as a default. +To switch to wait mode add the following to mpiexec command: + -genv I_MPI_WAIT_MODE 1 +NOTE: Wait mode supports the sock device only. ======================================== Recommended Setting for MVAPICH2 and OFA @@ -194,7 +168,7 @@ Recommended Setting for MVAPICH2 and OFA Example mpirun_rsh command line: mpirun_rsh -ssh -np 2 -hostfile /root/mpd.hosts - /usr/mpi/gcc/mvapich2-1.6/tests/osu_benchmarks-3.1.1/osu_latency + /usr/mpi/gcc/mvapich2-1.7/tests/osu_benchmarks-3.1.1/osu_latency MVAPICH2 use CQ Polling mode as a default. To switch to Blocking mode add the following to mpirun_rsh command: @@ -212,21 +186,19 @@ Example mpirun_rsh command with uDAPL-2.0: mpirun_rsh -ssh -np 64 -hostfile /root/mpd.hosts MV2_DAPL_PROVIDER=ofa-v2-iwarp MV2_ON_DEMAND_THRESHOLD=64 - /usr/mpi/gcc/mvapich2-1.6/tests/IMB-3.2/IMB-MPI1 + /usr/mpi/gcc/mvapich2-1.7/tests/IMB-3.2/IMB-MPI1 Example mpirun_rsh command with uDAPL-1.2: mpirun_rsh -ssh -np 64 -hostfile /root/mpd.hosts MV2_DAPL_PROVIDER=OpenIB-iwarp MV2_ON_DEMAND_THRESHOLD=64 - /usr/mpi/gcc/mvapich2-1.6/tests/IMB-3.2/IMB-MPI1 + /usr/mpi/gcc/mvapich2-1.7/tests/IMB-3.2/IMB-MPI1 MVAPICH2 use CQ Polling mode as a default. To switch to Blocking mode add the following to mpirun_rsh command: MV2_USE_BLOCKING=1 - - =========================== Modify Settings in Open MPI =========================== @@ -236,7 +208,6 @@ for your environment: http://www.open-mpi.org/faq/?category=tuning#setting-mca-params - ======================================= Recommended Settings for Open MPI 1.4.3 ======================================= @@ -255,7 +226,6 @@ Example mpirun command line: OpenMPI use CQ Polling mode as a default. No command parameter available to swith to Event Driven mode. - =================================== iWARP Multicast Acceleration (IMA) =================================== -- 2.41.0