Open Fabrics Enterprise Distribution (OFED)
- Version 3.12-rc3 Release Notes
+ Version 3.12 Release Notes
May 2014
===============================================================================
Table of Contents
===============================================================================
1. Overview, which includes:
- - OFED Distribution Rev 3.12-rc3 Contents
+ - OFED Distribution Rev 3.12 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
1. Overview
===============================================================================
These are the release notes of OpenFabrics Enterprise Distribution (OFED)
-release 3.12-rc2. The OFED software package is composed of several software modules,
+release 3.12. The OFED software package is composed of several software modules,
and is intended for use on a computer cluster constructed as an InfiniBand
Fabric, an iWARP Network or a RoCE Fabric.
all of its nodes to this new version.
-1.1 OFED 3.12-rc3 Contents
+1.1 OFED 3.12 Contents
-----------------------
The OFED package contains the following components:
- OpenFabrics core and ULPs:
- - IB HCA drivers (mthca, mlx4, mlx5, qib, ehca, ocrdma)
+ - IB HCA drivers (mthca, mlx4, mlx5, qib, ehca)
- iWARP RNIC driver (cxgb3, cxgb4, nes)
- RoCE drivers (mlx4, ocrdma)
- ib core
- - Upper Layer Protocols: IPoIB, SRP Initiator and target, iSER
- Initiator and target, RDS, uDAPL, qlgc_vnic and NFS-RDMA*.
+ - Upper Layer Protocols: IPoIB, SRP Initiator and target, RDS,
+ uDAPL, qlgc_vnic and NFS-RDMA*.
- OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
1.3 HCAs and RNICs Supported
----------------------------
-This release supports IB HCAs by IBM, Intel and Mellanox Technologies, iWARP RNICs by Chelsio Communications and Intel and RoCE adapters by IBM and Mellanox.
+This release supports IB HCAs by IBM, Intel and Mellanox Technologies, iWARP RNICs by Chelsio Communications and Intel and RoCE adapters by Emulex, IBM and Mellanox.
InfiniBand Adapters
o IBM HCAs:
- Intel(R) True Scale QDR PCIe x8 Gen2 HCAs
o Mellanox Technologies HCAs (SDR, DDR and QDR Modes are Supported):
- - ConnectX(R) and ConnectX EN (fw-25408 Rev 2.9.1000)
- - ConnectX-2 (fw-ConnectX2 Rev 2.9.1000)
+ - ConnectX(R) and ConnectX EN (Rev 2.9.1000)
+ - ConnectX®-2 (Rev 2.9.1200 and above)
+
o Mellanox Technologies HCAs (FDR and FDR10 Modes are Supported):
- - ConnectX-3 (fw-ConnectX3 Rev 2.30.8000)
+ - ConnectX®-3 (Rev 2.31.5050 and above)
+ - ConnectX®-3 Pro (Rev 2.31.5050 and above)
+
o Mellanox Technologies HCAs (FDR and FDR10 Modes are Supported):
- - Connect-IB™ (fw-ConnectIB.mlx Rev 10.10.2000 and above)
+ - Connect-IB® (Rev 10.10.3000 and above)
For official firmware versions please see:
http://www.mellanox.com/content/pages.php?pg=firmware_download
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310/R320 10GbE iWARP Adapters
- - T4 Based Adapters with the exception of the T420-SO-CR
+ - T4: T420-CR, T440-CR, T422-CR, T404-BT, T440-LP-CR, T420-LL-CR, T420-CX
+ - T5: T502-BT, T580-CR, T580-LP-CR, T520-LL-CR, T520-CR, T522-CR, T540-CR
o Intel RNICs:
- NE020 10Gb iWARP Adapter
RoCE Adapters
+ o Emulex - using ocrdma
+ - Emulex OCe14102 2-port 10 GbE RoCE
+ - Emulex OCe14401 1-port 40 GbE RoCE
+
o IBM
- IBM Flex System EN4132 2-port 10 GbE RoCE
- IBM EL27 PCIe LP 2-Port 10GbE RoCE SFP+ adapter
- IBM EC28 PCIe 2-Port 10GbE RoCE SFP+ adapter
o Mellanox
- - ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1200)
- - ConnectX-3 EN (fw-ConnectX3 Rev 2.11.0500)
+ - ConnectX-2 EN (Rev 2.9.1200 and above)
+ - ConnectX-3 EN (Rev 2.31.5050 and above)
1.4 Switches Supported
----------------------
o Intel (formerly QLogic)
- 12200
o Mellanox
- - IS-5030
- - SX6025
- - SX6036
+ - MLNX-OS® MSX6036/SX6025 w/w MLNX-OS® version 3.3.4304
+ - Grid Director™ 4036 w/w Grid Director™ version 3.9.2-992
+ - FabricIT™ EFM IS5035 w/w FabricIT EFM version 1.1.3000
+ - FabricIT™ BXM MBX5020 w/w FabricIT BXM version 2.1.2000
iWARP Switches
o Fujitsu
1.5 Third Party Packages
------------------------
-The following third party packages have been tested with OFED 3.12-rc2:
-- OpenMPI-1.8.1
-- mvapich2-1.9
-- IntelMPI-4.1.1.036
+The following third party packages have been tested with OFED 3.12:
+- Open MPI - 1.8
+- Intel MPI 4.1.3
+- MVAPICH2
1.6 OFED Sources
----------------
OFED-3.12-rc3 Main Changes from OFED 3.12-rc2
-------------------------------------------------------------------------------
1. Updated packages:
- - perftest-2.2-0.17.g5eba807
+ - perftest-2.2-0.17
+2. Bugs solved
OFED-3.12-rc2 Main Changes from OFED 3.12-rc1
-------------------------------------------------------------------------------
/etc/modprobe.d/unsupported-modules. Without this the modules will not
load.
08. RDS is supported only on kernel.org 3.5 and not on any distro OS.
-09. There are known issues with iWARP using Chelsio adapters which will be
- resolved in OFED 3.12 RC3 See Bugs 2482 and 2485
-10. There is an issue with NFSoRDMA when running on Power PC. This will be
+09. There is an issue with NFSoRDMA when running on Power PC. This will be
resolved in OFED 3.12-1 - see Bug 2449
-11. Newer SLES or RHEL patch kernels that are updates to the original kernel that is included in the
- original SLES or RHEL distibutions may not work with OFED-3.12-rc2. The list of kernels that are supported are listed in
+10. There are known issues with iWARP using Chelsio adapters which will be
+ resolved in OFED 3.12-1 See Bugs 2482, 2485 and 2487
+11. There are some issues with NFSoRDMA and there are some pending patches on kernel.org. These will be
+ resolved in OFED 3.12-1 - see Bugw 2489 and 2490
+12. Newer SLES or RHEL patch kernels that are updates to the original kernel that is included in the
+ original SLES or RHEL distibutions may not work with OFED-3.12. The list of kernels that are supported are listed in
section 1.2.
Note: See the release notes of each component for additional issues.