+++ /dev/null
-<html>\r
-\r
-<head>\r
-<meta http-equiv=Content-Type content="text/html; charset=windows-1252">\r
-<meta name=Generator content="Microsoft Word 11 (filtered)">\r
-\r
-<style>\r
-<!--\r
- /* Font Definitions */\r
- @font-face\r
- {font-family:Wingdings;\r
- panose-1:5 0 0 0 0 0 0 0 0 0;}\r
-@font-face\r
- {font-family:"MS Mincho";\r
- panose-1:2 2 6 9 4 2 5 8 3 4;}\r
-@font-face\r
- {font-family:"\@MS Mincho";\r
- panose-1:2 2 6 9 4 2 5 8 3 4;}\r
- /* Style Definitions */\r
- p.MsoNormal, li.MsoNormal, div.MsoNormal\r
- {margin:0in;\r
- margin-bottom:.0001pt;\r
- font-size:12.0pt;\r
- font-family:"Times New Roman";}\r
-h1\r
- {margin-right:0in;\r
- margin-left:0in;\r
- font-size:24.0pt;\r
- font-family:"Times New Roman";\r
- font-weight:bold;}\r
-h2\r
- {margin-right:0in;\r
- margin-left:0in;\r
- font-size:18.0pt;\r
- font-family:"Times New Roman";\r
- font-weight:bold;}\r
-h3\r
- {margin-right:0in;\r
- margin-left:0in;\r
- font-size:13.5pt;\r
- font-family:"Times New Roman";\r
- font-weight:bold;}\r
-h4\r
- {margin-right:0in;\r
- margin-left:0in;\r
- font-size:12.0pt;\r
- font-family:"Times New Roman";\r
- font-weight:bold;}\r
-a:link, span.MsoHyperlink\r
- {color:blue;\r
- text-decoration:underline;}\r
-a:visited, span.MsoHyperlinkFollowed\r
- {color:blue;\r
- text-decoration:underline;}\r
-p.MsoPlainText, li.MsoPlainText, div.MsoPlainText\r
- {margin:0in;\r
- margin-bottom:.0001pt;\r
- font-size:10.0pt;\r
- font-family:"Courier New";}\r
-p\r
- {margin-right:0in;\r
- margin-left:0in;\r
- font-size:12.0pt;\r
- font-family:"Times New Roman";}\r
-@page Section1\r
- {size:8.5in 11.0in;\r
- margin:1.0in 65.95pt 1.0in 65.95pt;}\r
-div.Section1\r
- {page:Section1;}\r
- /* List Definitions */\r
- ol\r
- {margin-bottom:0in;}\r
-ul\r
- {margin-bottom:0in;}\r
--->\r
-</style>\r
-\r
-</head>\r
-\r
-<body lang=EN-US link=blue vlink=blue>\r
-\r
-<div class=Section1>\r
-\r
-<h1 align=center style='text-align:left'><img width=107 height=93\r
-src=openfabrics.gif></h1>\r
-\r
-<h1 align=center style='text-align:center'>Windows OpenFabrics </h1>\r
-\r
-<h1 align=center style='text-align:center'>1.0.1 Release Notes</h1>\r
-\r
-<h3 align=center style='text-align:center'>\r
-<!--webbot bot="Timestamp" S-Type="EDITED" S-Format="%m/%d/%Y" startspan -->10/17/2007<!--webbot bot="Timestamp" endspan i-checksum="12611" --></h3>\r
-\r
-<div class=MsoNormal align=center style='text-align:center'>\r
-\r
-<hr size=2 width="100%" align=center>\r
-\r
-</div>\r
-\r
-<h2><u>Overview</u></h2>\r
-\r
-<p class=MsoPlainText><span style='font-size:12.0pt;font-family:"Times New Roman"'>The\r
-Windows OpenFabrics (WinOF) release package is composed of software modules\r
-intended for use on Microsoft Windows based computer systems connected via an\r
-InfiniBand fabric.</span></p>\r
-\r
-<p class=MsoPlainText><span style='font-size:12.0pt;font-family:"Times New Roman"'> Binary\r
-files generated from the openib-windows developers subversion (svn) source tree </span>\r
-'svn://openib.tc.cornell.edu'<span style='font-size:12.0pt;font-family:"Times New Roman"'> \r
-(svn revision 864)\r
-are packaged into a <a href="http://www.dalun.com/wix/default.htm">WIX 2.0 \r
-(Windows Installer Xml)</a> single file install package referred to as\r
-the Windows OpenFabrics (WinOF) release 1.0.1.<br>\r
- </span></p>\r
-<p class=MsoPlainText><font size="3"><span style="font-family: Times New Roman">\r
-This WinOF 1.0.1 is considered a refresh to WinOF 1.0 as it contains bug fixes \r
-to numerous components:</span></font></p>\r
-<ul>\r
- <li>\r
- <p class=MsoPlainText><font face="Times New Roman" size="3">\r
- (IBBUS,MTHCA,SRP)</font></p>\r
-<ul>\r
- <li>\r
- <p class=MsoPlainText><font face="Times New Roman" size="3">Added support \r
- for fmr_pool (only for kernel).</font></p></li>\r
- <li>\r
- <p class=MsoPlainText><font face="Times New Roman" size="3">New functions to \r
- IBAL interface, so its version increased.</p></li>\r
-</ul></font></li>\r
- <li>\r
- <p class=MsoPlainText><font size="3">\r
- <span style="font-family: Times New Roman">IA64 alignment issues resolved in \r
- WSD and IB verbs.</span></font></p></li>\r
- <li>\r
- <p class=MsoPlainText><font size="3">\r
- <span style="font-family: Times New Roman">WSD null pointer fix included, in \r
- addition to other WSD enhancements.</span></font></p></li>\r
- <li>\r
- <p class=MsoPlainText><font size="3">\r
- <span style="font-family: Times New Roman">SRP issues addressed:</span></font></p>\r
-<ul>\r
- <li>\r
- <p class=MsoPlainText><font face="Times New Roman" size="3">New flow \r
- management mechanism for better sustaining work load under stress</font></p>\r
- </li>\r
- <li>\r
- <p class=MsoPlainText><font face="Times New Roman" size="3">added Registry \r
- parameter ModeFlags (for debugging and tuning purposes):<br>\r
- </font><font SIZE="2">1</font><font face="Times New Roman" size="3"> - don't \r
- use FMR_POOL, 2 - increase StorPort SG list (disallowed by DDK).</font></p>\r
- </li>\r
- <li>\r
- <p class=MsoPlainText><font size="3" face="Times New Roman">Support maximal \r
- buffer size (up to 1MB). It was 64KB, because of StorPort limitation of 16 \r
- SG list size.</font></p></li>\r
-</ul></li>\r
- <li>\r
- <p class=MsoPlainText><font size="3">\r
- <span style="font-family: Times New Roman">DAPL 1.1 runtime library fixes \r
- plus DAT header file fixes along with an optional \r
- DAT 1.1 application build environment</span></font></p></li>\r
- <li>\r
- <p class=MsoPlainText><font size="3">\r
- <span style="font-family: Times New Roman">DAPL 2.0 runtime libraries with \r
- optional DAT 2.0 \r
- build environment.</span></font></p></li>\r
-</ul>\r
-\r
-</div>\r
-<p class="MsoPlainText"> </p>\r
-<p class="MsoPlainText"><font face="Times New Roman" size="3">Although WinOF \r
-1.0.1 has not under gone an extensive Mellanox QA cycle which WinOF 1.0 \r
-(svn.614) received, it is believed WinOF 1.0.1 is more robust due to the \r
-specific component patches applied.</font></p>\r
-<p class="MsoPlainText"> </p>\r
-<div class=Section1>\r
-\r
-<p>The Windows OpenFabrics (WinOF) release package contains the following:<br>\r
-<br>\r
-OpenFabrics InfiniBand core drivers and Upper Level Protocols (ULPs):</p>\r
-<ul>\r
- <li>\r
- <p style="text-indent: -.25in; margin-left: .5in"><span dir="LTR">MTHCA -<span style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll'> \r
- Mellanox </span></span><st1:stockticker>\r
- <span\r
- style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll'>HCA</span></st1:stockticker><span\r
-style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll'> low level driver; See list of\r
-supported devices below<br>\r
- </span></li>\r
- <li>\r
- <p style="text-indent: -.25in; margin-left: .5in">\r
- <span style="background-position: 0% 0%">Infiniband Core components<br>\r
- </span></li>\r
- <li>\r
- <p style="text-indent: -.25in; margin-left: .5in">Upper Layer Protocols: \r
- IPoIB, WSD, SRP Initiator and DAT/DAPL</li>\r
-</ul>\r
-\r
-<p>OpenFabrics utilities:</p>\r
-\r
-<ul>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>OpenSM: InfiniBand fabric Subnet Manager</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>Performance tests</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>Diagnostic tools</span></p>\r
- </li>\r
-</ul>\r
-\r
-<p>Documentation</p>\r
-\r
-<ul>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>User's manual</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>Release Notes</span></p>\r
- </li>\r
-</ul>\r
-\r
-<h2> </h2>\r
-<h2><u>Supported Platforms, Operating Systems and Infiniband Hardware</u></h2>\r
-\r
-<h4>CPU architectures</h4>\r
-\r
-<ul>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>x64 (x86_64, amd64)</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>x86</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>IA64</span></p>\r
- </li>\r
-</ul>\r
-\r
-<h4>Operating Systems</h4>\r
-\r
-<ul>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir="LTR">Windows Server 2003</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>Windows Server 2003 Compute Cluster Edition</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>Windows XP (SP2)</span></p>\r
- </li>\r
-</ul>\r
-\r
-<h4><u>Supported HCAs (Host Channel Adapters)</u></h4>\r
-\r
-<p>Mellanox (mthca.inf)</p>\r
-<ul>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in;mso-list:l13 level1 lfo1;\r
-tab-stops:list .5in'><![if !supportLists]><font size="3">\r
- <span style='background-position: 0% 0%; font-style:normal; font-variant:normal; font-weight:normal; font-family:Times New Roman; mso-list:Ignore; mso-bidi-font-size:12.0pt; mso-fareast-font-family:Symbol; mso-bidi-font-family:Symbol; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll'>\r
- MT23108 - InfiniHost</span></font><![endif]></p></li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in;mso-list:l13 level1 lfo1;\r
-tab-stops:list .5in'>\r
- <span style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll' dir="LTR">MT25218 \96 InfiniHost III Ex, memfree</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in;mso-list:l13 level1 lfo1;\r
-tab-stops:list .5in'>\r
- <span style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll' dir="LTR">MT25204 \96 InfiniHost III Lx<o:p></o:p></span></p>\r
- </li>\r
-</ul>\r
-<p>Both SDR and DDR mode of the InfiniHost III family are supported.<br><br>For official Firmware (FW) versions and update tools please see:<br>\r
-<a href="http://www.mellanox.com/support/firmware_table.php">http://www.mellanox.com/support/firmware_table.php</a></p>\r
-\r
-<h4><u>Supported Switches</u></h4>\r
-\r
-<ul>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir="LTR">QLogic</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>SilverStorm</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir="LTR">Voltaire</span></p>\r
- </li>\r
- <li>\r
- <p style='margin-left:.5in;text-indent:-.25in'><span dir=LTR>Flextronics</span></p>\r
- </li>\r
-</ul>\r
-\r
-<h2> </h2>\r
-<h2><u>Installation Specifics</u></h2>\r
-\r
-<p>User mode tools and diagnostics are installed in '%SystemDrive%\Program\r
-Files (x86)\WinOF'. Although driver modules initially reside in \r
-'%SystemDrive%\Program Files (x86)\WinOF', when installed the Windows device \r
-installer relocates driver modules to %SystemRoot%\system32 & %SystemRoot%\SysWOW64'. \r
-DAT & DAPL runtime libraries are installed into %SystemRoot% in order to be \r
-accessible to user mode applications.<br>\r
-WinOF user mode executables are designed to be run from\r
-a Command Prompt window; see 'Start->Program Files-> Windows OpenFabrics-> Command Prompt'.</p>\r
-<p>'%SystemDrive%\Program Files (x86)\WinOF' is appended to the system wide search \r
-path; new command windows created after the installation will have the updated \r
-%PATH% environment variable, hence will be able to access WinOF utilities.</p>\r
-\r
-<p>The \91default\92 installation installs \91released/free\92 (not\r
-checked/debug) versions of drivers and executables.</p>\r
-\r
-<p>A single instance of a subnet manager, opensm.exe, must be\r
-running on a fabric connected node in order for the Infiniband fabric to be\r
-configured and useful; either Windows or Linux opensm work well.</p>\r
-<p>It is recommended that OpenSM be run as a Windows service. A typical \r
-WinOF install will install OpenSM as a Windows service which \r
-is disabled; after an installation, choose your openSM node and start the openSM \r
-service. \r
-See the WinOF Manual for details on opensm as a service.<br>\r
-By selecting the 'OpenSM_service_enabled' feature, an OpenSM subnet \r
-management service will be automatically started. </p>\r
-\r
-<p>Note, the opensm.exe process must continue to run in order\r
-to maintain Infiniband fabric configuration. Should the opensm.exe process die,\r
-restart the service if not automatic or re-run opensm.exe in order to continue\r
-correct fabric operation.</p>\r
-\r
-<p>For more subnet management information, consult the Windows\r
-OpenFabrics manual.</p>\r
-\r
-<p class=MsoNormal> </p>\r
-\r
-<h2><u>How to Install</u></h2>\r
-\r
-<h3>Requirements</h3>\r
-\r
-<p>Install HCA hardware prior to installing the Windows OpenFabrics Release\r
-package. Upon reboot, cancel any attempts to install new device hardware from \r
-the "Found New Hardware Wizard".</p>\r
-\r
-<p>If you have previously installed openib-windows, Windows OpenFabrics\r
-packages or vendor supplied Infiniband packages, uninstall and reboot prior to\r
-installing this version of Windows OpenFabrics (WinOF).</p>\r
-\r
-<p>For an existing Windows OpenFabrics uninstall<br>\r
- Programs-> Windows OpenFabrics-> Uninstall WinOF<br>\r
- -or-<br>\r
- Control Panel -> Add or Remove Programs-> Windows\r
-OpenFabrics->Remove.</p>\r
-<p>openib-windows uninstall:</p>\r
-\r
-<ol start=1 type=1>\r
- <li class=MsoNormal>Stop the openSM subnet manager if it is running on the \r
- local node.</li>\r
- <li class=MsoNormal>Disable any Local Area Connections which are bound to the\r
- IPoIB network adapter.</li>\r
- <li class=MsoNormal>Uninstall the IPoIB driver - My\r
- computer->Manage->Devices->Network Adapters->IPoIB*</li>\r
- <li class=MsoNormal>Uninstall the Infiniband HCA device; don't forget the \r
- System Device-> InfiniBand Fabric</li>\r
-</ol>\r
-\r
-<p> </p>\r
-\r
-<p><b>REBOOT</b></p>\r
-\r
-<p>Upon system restart, cancel the 'Found New Hardware Wizard' attempt to install \r
-drivers for newly discovered PCI device.</p>\r
-<p>'My Computer->Manage->Device Manager' should display\r
-'Other Devices->?PCI device' which is your Infiniband HCA device.</p>\r
-\r
-<h3><u>Install</u></h3>\r
-\r
-<blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'>\r
-\r
-<p>From a login with administrator privileges, double-click the\r
-WinOF_M-m_arch_setup.msi file to begin the Windows OpenFabrics installation; \r
-where '_arch_' can be (_x64_ for Intel EMT64 systems or amd64, _x86_ for x86\r
-compatible systems or _ia64_ for Intel IA64 systems). </p>\r
-\r
-<p>Follow the instructions.<br>\r
-Answer 'yes' or 'Continue' to any notifier windows which reference non-signed \r
-driver installation. These non-signed driver install questions can be disabled \r
-via 'My Computer->Properties->Hardware->Driver Signing->Ignore'.</p>\r
-<p>Bottom-line - WinOF drivers in this package are not WHQL'ed although they are \r
-built from driver source which has been WHQL'ed.</p>\r
-<p> </p>\r
-<p> <font size="4">**** WARNING ****</font></p>\r
-<blockquote>\r
- <p>Should any 'Welcome to the Found New Hardware Wizard' windows popup after the \r
- WinOF install has started, just ignore (window will disappear in a few \r
- seconds) or 'Cancel' the errant popup window. \r
- For Windows Server 2003 (SP1) you can safely ignore the errant FNHW popup \r
- window; for Windows XP (SP2) the errant FNHW popups need to be 'cancelled' \r
- in order for the WinOF install to proceed. The report back from Microsoft on these 'Found New Hardware Wizard' windows \r
- popping up is they are due to the fact the WinOF drivers are not Digitally \r
- signed (non-WHQL'ed) and hence are not trusted by Windows. Even though the \r
- Ignore warning on installation of non-signed drivers is enabled (My \r
- Computer->Properties->Hardware->Driver Signing->Ignore) the FNHW is still \r
- invoked. MS claims this is a 'feature'.</p>\r
- <p>An artifact of cancelling an errant 'Found New Hardware' popup window may \r
- induce an errant taskbar Information notifier/bubble indicating there may \r
- have been problems installing your hardware drivers;<br>\r
- IGNORE/cancel this information bubble, likely the device installation \r
- proceeded without error. Check the Device Manager views for the \r
- Infiniband HCA and IPoIB Network Adapters for initial verification of \r
- correct installation.</p>\r
- <p>You do need to answer 'Yes' or 'Continue' to those notifier windows which \r
- reference non-signed driver installation. If you have previously \r
- set My Computer->Properties->Hardware->Driver Signing->Ignore, then you will \r
- NOT be queried about installation of non-signed drivers; although the FNHW \r
- windows likely will occur.</p>\r
- <p>Should the install appear to hang, look around for occluded notifier windows \r
- waiting for a response which \r
- are covered by existing windows.<br>\r
- </p>\r
-</blockquote>\r
-\r
-<h4>Install type: Custom only</h4>\r
-\r
-<ul type=disc>\r
- <li class=MsoNormal>InfiniBand Core:<ul type=disc>\r
- <li>HCA driver, IB core stack and libraries.</li>\r
- <li>Release Notes, Manual</li>\r
- <li>Subnet Management [opensm], Performance & Diagnostic tools</li>\r
- </ul></li>\r
- <li>Optional:<br> IPoIB - Internet Protocols over \r
- InfiniBand<br> \r
- Winsock Direct (Win2K3 only)<br> VNIC - Virtual Ethernet device over Infiniband<br> SRP - SCSI over RDMA Protocol<br> \r
- DAT/DAPL \r
- - RDMA device independent, user-mode Direct Access Transport & Direct Access \r
- Provider<br>\r
- - DAT v1.1 runtime libraries.<br> - DAT v1.1 application build environment \r
- (header files & link files).<br> - DAT/DAPL v2.0 runtime libraries<br> - DAT v2.0 application build environment<br> OpenSM_service_started - InfiniBand Subnet Management \r
- enabled and started as a Windows Service.<br> \r
- By default OpenSM is installed as a disabled Windows Service.</li>\r
- <li>The '<b>default</b>' installation includes IB core, IPoIB, WSD (Win2K3 only), \r
- DAT 1.1 runtime libraries, OpenSM service (disabled).</li>\r
-</ul>\r
-\r
-</blockquote>\r
-\r
-<h3> </h3>\r
-<h3><u>Unattended Install</u></h3>\r
-\r
-<div id="main-copy">\r
- <p>To perform a silent/unattended installation, invoke the following command \r
- from a command window.</p>\r
- <blockquote>\r
- <p>start/wait msiexec.exe /i WinOF_x64_1-0-1.msi /quiet /passive /log \r
- %TEMP%\WOF_install.log</p>\r
- <p>'/log dev:path\logFilename.log' is optional.</p>\r
- <p>msiexec.exe /? for all options.</p>\r
- </blockquote>\r
- <p>An unattended install will install the following 'default' install options:</p>\r
- <ul>\r
- <li>Infiniband Core - HCA driver, IB core stack and libraries, \r
- Documentation</li>\r
- <li>IPoIB - Internet Protocols over InfiniBand</li>\r
- <li>WSD - (Win2k3 only, not installed on XP) Win Sock Direct</li>\r
- <li>DAT & DAPL (v1.1) runtime libraries.</li>\r
- </ul>\r
-</div>\r
-<p>Should WSD not be a desirable unattended install option (Win2K3 only), \r
-currently you would install unattended then execute the command 'installsp -r' \r
-on each node to remove WSD.</p>\r
-<p>See <a href="http://unattended.sourceforge.net/installers.php">Unattended \r
-Installations</a> for further references.</p>\r
-<p> </p>\r
-<h3>Setting the IPoIB Interface IP Address</h3>\r
-<p>The Windows command 'netsh' will assist in assigning an IP address to an \r
-IPoIB interface.<br>\r
-By default, an IPoIB interface is configured to use DHCP. The following \r
-discussion deals with setting a static IP address on an IPoIB interface.</p>\r
-<p>Display all network interface configuration information<br>\r
- netsh interface ip show config<br>\r
- netsh interface ip show address \r
-"Local Area Connection 3"</p>\r
-<p>Config a static IP address for an IPoIB interface: [Local Area Connection 3 \r
-== 1st IPoIB interface], 10.10.4.300 is the assigned IP address<br>\r
-with a netmask of 255.255.255.0, the gateway is 10.10.4.1 metric is 2.</p>\r
-<p> netsh interface ip set address \r
-"Local Area Connection 3" static 10.10.4.300 255.255.255.0 10.10.4.1 2</p>\r
-<p>See <a href="http://support.microsoft.com/kb/257748">netsh</a> for further \r
-reference.</p>\r
-<p> </p>\r
-<h2><u>Uninstall</u></h2>\r
-\r
-<p>To uninstall a WinOF package from a single node</p>\r
-<ol>\r
- <li>Programs-> Windows OpenFabrics-> Uninstall WinOF</li>\r
- <li>Control Panel-> Add Remove Programs-> Windows OpenFabrics-> Remove</li>\r
-</ol>\r
-<h3><span style="font-weight: 400; text-decoration: underline">Unattended \r
-Uninstall</span></h3>\r
-<p>From a Command Window invoke the following command; a system reboot will \r
-occur after the uninstall.</p>\r
-<blockquote>\r
- <p>start/wait msiexec.exe /x {3A6A276E-A636-48E8-8624-9A0DE3F2A15E} /quiet /passive \r
- /forcerestart<br>\r
- - or -<br>\r
- start/wait msiexec.exe /x WinOF_x64_1-0-1.msi /quiet /passive /forcerestart \r
- # WinOF_xxxx.msi is the file used to install WinOF.</p>\r
- <p>msiexec.exe /help for details.</p>\r
- <p>'/log dev:path\logfilename.log' if you wish to later view the install \r
- results.</p>\r
- <p>If for some reason the Product Code {GUID} changes, the latest code can \r
- be located via<br>Programs-> Windows OpenFabrics-> Uninstall WinOF<right-click>Properties</p>\r
-</blockquote>\r
-<p>Infrequently, the 'System Device->Infiniband Fabric' may not correctly uninstall. Make sure the Infiniband Fabric device is \r
- completely uninstalled; use device manager for checking. The effect of a \r
- partially uninstalled Infiniband Fabric device is IPoIB load failure \r
- upon the next WinOF install.</p>\r
-<p> </p>\r
-\r
-<h2><u>Trouble Shooting</u></h2>\r
-<p>Down rev firmware will result in IPoIB not installing. Consult the event \r
-viewer, system error records, look for 'mthca' entries generated when the HCA \r
-driver loads. One of the mthca entries will display the current firmware \r
-revision.</p>\r
-<h3><u>Current Mellanox Firmware Revisions Matrix</u></h3><p:colorscheme\r
- colors="#ffffff,#000000,#808080,#000000,#ffc86c,#acc5ff,#fff4b4,#c4f48a"/>\r
-\r
-<div v:shape="_x0000_s1026" style="tab-stops:.6215in">\r
- <div class="O" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:145;\r
-mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family:"Arial Narrow";\r
-font-size:106%;color:#F2862F">\r
- <span style="mso-special-format:bullet;\r
-position:absolute;left:-3.41%">\95</span></span><span style="font-family:"Arial Narrow";\r
-font-size:19pt;color:#F2862F"><b> </b></span></div>\r
- <blockquote>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family:"Arial Narrow";font-size:94%;color:#241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-4.4%">\96</span></span><span style="font-family: Arial Narrow; color: #241172"><b>MT23108 \r
- (InfiniHost) </b></span></div>\r
- <blockquote>\r
- <div class="O2" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:577;\r
-mso-text-indent-alt:468;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-2.71%;font-family:\r
-Wingdings">§</span>Minimal FW version: 3.3.2 </span></div>\r
- <div class="O2" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:577;\r
-mso-text-indent-alt:468;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-2.71%;font-family:\r
-Wingdings">§</span>Optimal FW version: 3.4.0</span><span style="font-family:"Arial Narrow";font-size:\r
-16pt;color:#241172"> </span></div>\r
- </blockquote>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family:"Arial Narrow";font-size:94%;color:#241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-4.4%">\96</span></span><b><span style="font-family: Arial Narrow; color: #241172">MT25208 \r
- (InfiniHost III Ex, Tavor mode) </span></b></div>\r
- <blockquote>\r
- <div class="O2" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:577;\r
-mso-text-indent-alt:468;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-2.71%;font-family:\r
-Wingdings">§</span>Minimal FW version: 4.7.0 </span></div>\r
- <div class="O2" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:577;\r
-mso-text-indent-alt:468;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-2.71%;font-family:\r
-Wingdings">§</span>Optimal FW version: 4.7.400<font size="4"> </font></span>\r
- </div>\r
- </blockquote>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family:"Arial Narrow";font-size:94%;color:#241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-4.4%">\96</span></span><span style="font-family: Arial Narrow; color: #241172"><b>MT25218 \r
- (InfiniHost III Ex, memfree) </b></span></div>\r
- <blockquote>\r
- <div class="O2" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:577;\r
-mso-text-indent-alt:468;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-2.71%;font-family:\r
-Wingdings">§</span>Minimal FW version: 5.1.0 </span></div>\r
- <div class="O2" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:577;\r
-mso-text-indent-alt:468;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-2.71%;font-family:\r
-Wingdings">§</span>Optimal FW version: 5.1.400 </span></div>\r
- </blockquote>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-4.4%">\96</span><b>MT25204 \r
- (InfiniHost III Lx)</b></span></div>\r
- <blockquote>\r
- <div class="O2" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:577;\r
-mso-text-indent-alt:468;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-2.71%;font-family:\r
-Wingdings">§</span>Minimal FW version: 1.0.800 </span></div>\r
- <div class="O2" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:577;\r
-mso-text-indent-alt:468;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-2.71%;font-family:\r
-Wingdings">§</span>Optimal FW version: 1.1.0<b> </b></span></div>\r
- </blockquote>\r
- </blockquote>\r
- <div class="O" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:145;\r
-mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family:"Arial Narrow";\r
-font-size:106%;color:#F2862F">\r
- <span style="mso-special-format:bullet;\r
-position:absolute;left:-3.41%">\95</span></span><b><span style="font-family: Arial Narrow; ">If \r
- HCA FW is older than minimal FW</span><span style="font-family: Arial Narrow; color: #F2862F"> </span> </b></div>\r
- <blockquote>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172"><b>Error \r
- reported to system event log </b></span></div>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-4.4%">\r
- \96</span><b>HCA loads as memory controller to allow FW upgrade </b>\r
- </span></div>\r
- </blockquote>\r
- <div class="O" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:145;\r
-mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #F2862F">\r
- <span style="mso-special-format:bullet;\r
-position:absolute;left:-3.41%">\95</span></span><b><span style="font-family: Arial Narrow; ">If HCA<span style="mso-spacerun:yes"> \r
- </span>FW is equal or newer than optimal version</span><span style="font-family: Arial Narrow; color: #F2862F"><br>\r
- </span></b></div>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <blockquote>\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-4.4%">\r
- \96</span><b>HCA starts OK. </b></span>\r
- </blockquote>\r
- </div>\r
- <div class="O" style="mso-line-spacing:"80 20 0";mso-margin-left-alt:145;\r
-mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #F2862F">\r
- <span style="mso-special-format:bullet;\r
-position:absolute;left:-3.41%">\95</span></span><b><span style="font-family: Arial Narrow; ">Else</span></b></div>\r
- <blockquote>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <b>HCA loads OK. </b></span></div>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <span style="font-family: Arial Narrow; color: #241172">\r
- <span style="mso-special-format:bullet;position:absolute;left:-4.4%">\r
- \96</span><b>Warning will be issued to system event log </b></span>\r
- </div>\r
- </blockquote>\r
- <div class="O1" style="mso-line-spacing:"80 0 0";mso-margin-left-alt:395;\r
-mso-text-indent-alt:217;mso-char-wrap:1;mso-kinsoku-overflow:1">\r
- <![if ppt]>\r
- <span style="font-family:"Arial Narrow";font-size:94%;color:#241172;visibility:hidden">\r
- <span style="mso-special-format:bullet;position:absolute;left:-4.4%">\96</span></span><![endif]><span style="font-family:"Arial Narrow";font-size:17pt;color:#241172"><b>\r
- </b></span></div>\r
- <div class="O" style="mso-line-spacing:"80 50 0";mso-margin-left-alt:145">\r
- My computer-> Manage-> Event Viewer-> System Events<p>Firmware updates \r
- are available at\r
- <a href="http://www.mellanox.com/support/firmware_download.php">\r
- www.mellanox.com/support/firmware_download.php</a></p>\r
- <h3><u>Incomplete Previous Uninstall</u></h3>\r
- <p>Should the previous uninstall silently fail, the next installation \r
- can fail in the Driver Install phase with the following error:<br>\r
- DriverInstall - HCA Ret 2 Error 0<br>\r
- <br>\r
- At this juncture, check the Device Manager and uninstall the PCI \r
- device from 'InfiniBand Host Channel Adapters', and make sure you uninstall the system device\r
- 'InfiniBand Fabric'.<br>\r
- <br>\r
- <u><b>REBOOT</b></u> and retry the WinOF installation again.</div>\r
-</div>\r
-<h3><u>Correct Installation Validation</u></h3>\r
-<p>From the Device Manager you should find the following devices:</p>\r
-<ul>\r
- <li>InfiniBand Host Channel Adapters -> Infinihost</li>\r
- <li>System Devices -> InfiniBand Fabric</li>\r
- <li>Network Adapters -> OpenIB IPoIB Adapter (an Instance per HCA port).</li>\r
-</ul>\r
-<blockquote>\r
- <h4>Validation Test</h4>\r
- <p>Open a WinOF command window</p>\r
- <ol>\r
- <li>Start->Program Files->Windows OpenFabrics -> Command \r
-Window</li>\r
- <li>run vstat.exe to view HCA configuration.</li>\r
- <li>If IPoIB is installed (Device Manager->Network Adapters), ping another node on the InfiniBand fabric 'ping a.b.c.d'<br>\r
- </li>\r
- </ol>\r
-</blockquote>\r
-<h3><u>OpenIB Subnet Management as a Windows Service</u></h3>\r
-<p>Limit the number of Subnet Managers on your fabric; one SM per fabric is \r
-sufficient, although redundant Subnet Managers are supported.</p>\r
-<ol>\r
- <li>After a 'typical' WinOF install, OpenSM is installed as a <b>disabled</b> \r
- Windows service named "InfiniBand Subnet Management". To start the OpenSM \r
- service, use My computer->Manage->Services and Applications->Services->InfiniBand Subnet Manager->Start.<br>\r
- Set the service properties to 'auto' in order to restart upon the next \r
- system reboot.<br>\r
- </li>\r
- <li>Install OpenSM as an automatic/running Windows service:<br>\r
- a) Request a 'Custom' install, selecting the 'OpenSM_service_enabled' feature. Once \r
- the install has completed, check that the Infiniband Subnet Manager service is \r
- running: My computer->Manage->Services and Applications->Services->InfiniBand Subnet \r
- Manager.<br>\r
- </li>\r
- <li>Consult the OpenSM log file @ %SystemRoot%\temp\osm.log to see what \r
- OpenSM thinks is happening.</li>\r
-</ol>\r
-<p> </p>\r
-<h3><u>Local Network Adapter Ordering</u></h3>\r
-<p>Local Network Adapter ordering, which results in the IP address advertised \r
-for the system, can be managed from<br> 'My Network Places-> Advanced Tab-> Advanced settings'<br>From the Advanced settings display, the ordering \r
-of Local Network Adapters can be \r
-reordered after the IPoIB Local Network Adapters have been installed. Please \r
-check for your desired adapter ordering.<br> </p>\r
-<h3><u>Which WinOF release is installed</u>?</h3>\r
-<ol>\r
- <li>Add/Remove Programs entry identifies the WinOF release version.</li>\r
- <li>Start->Programs->Windows OpenFabrics->Release Notes \r
-(2nd Line)</li>\r
- <li>Driver confirmation:<br> Query My Computer-> Manage-> Device Manager-> Network \r
-Adapters-> OpenIB IPoIB Adapter-> Properties-> Driver-> Details<br> The subversion (svn) revision number will be listed under \r
-'Driver Version'. The svn revision number will match what's listed in the \r
-release<br> notes.</li>\r
- <li>Hold the mouse point over \Program Files(x86)\WinOF\ib_read_bw.exe to display \r
-the file version; the 4th field is the svn revision number.</li>\r
-</ol>\r
-<ul>\r
- <li>WinOF 1.0 is based on openib-windows <b><u>svn revision 614</u></b> @\r
- <a href="http://openib.tc.cornell.edu/downloads/binaries/">http://openib.tc.cornell.edu/downloads/binaries/</a> .<br>\r
- </li>\r
- <li>WinOF 1.0.1 is based on openib-windows <b><u>svn revision 864</u></b>.</li>\r
-</ul>\r
-<h3> </h3>\r
-<h3><u>DAT & uDAPL Configuration</u></h3>\r
-<p align="left">In order for DAT/DAPL programs to execute correctly, the 'dat.dll' \r
-file must be present in the current directory,\r
-%SystemRoot% or in the library search path.</p>\r
-<p align="left">WinOF installation places the dat.dll and dapl.dll \r
-files in the '%SystemRoot%' \r
-folder (a.k.a. \Windows).</p>\r
-<p align="left">The DAT/DAPL configuration file by convention is defined as \r
-'%SystemDrive%\DAT\dat.conf'. If the file '%SystemDrive%\DAT\dat.conf' does not exist, \r
-a template configuration file will be installed as '%SystemDrive%\DAT\dat.conf'.<br>\r
-In order to preserve existing installations, the dat.conf file is not \r
-automatically installed if '%SystemDrive%\DAT\dat.conf' exists.<br>\r
-A sample dat.conf file is always installed as '\Program Files (x86)\WinOF\dat.conf \r
-'.</p>\r
-<p align="left">The default DAT configuration file specification can be overridden by use \r
-of the environment variable DAT_OVERRIDE. Such that 'DAT_OVERRIDE=D:\MyDAT\test.conf' \r
-would be a valid override specification.</p>\r
-<p align="left">Within the dat.conf file, the DAPL library specification can be \r
-located as the 5th whitespace separated line argument. By default the DAPL \r
-library file is installed as %WINDIR%\dapl.dll'.</p>\r
-<p align="left">Should you choose to relocate the DAPL library file to a folder \r
-where whitespace appears in the full library path specification, then the full \r
-library file specification must be contained within double-quotes. A side effect \r
-of the double-quotes is the library specification is treated as a Windows string \r
-which implies the '\' (backslash character) is treated as an 'escape' character. \r
-Hence all backslashes in the library path must be duplicated when enclosed in \r
-double-quotes (e.g., "C:\\Programs Files (x86)\\WinOF\\dapl.dll").</p>\r
-<h4 align="left"><span style="font-weight: 400">DAT/DAPL version 2.0 runtime \r
-libraries are identified as dat2.dll and dapl2.dll, both in %SystemRoot%; see \r
-manual for further details.<br>\r
- </span></h4>\r
-<h3 align="left"><u>SRP - SCSI RDMA Protocol Driver Installation</u></h3>\r
-<p align="left">The WinOF stack does not install the SRP driver by default. \r
-If SRP is\r
-selected in the custom installation window, it will only be copied during WinOF\r
-installation. To complete the SRP driver installation, an SRP target must be\r
-detected; a Subnet Manager must be running somewhere in the InfiniBand subnet.<br>\r
-<br>\r
-Upon the detection of an SRP target, the "New Hardware Found" Wizard pops up.<br>\r
-- Select Install Automatically and click Next. This installs the I/O unit \r
-device.<br>\r
-<br>\r
-Once completed, the "New Hardware Found" Wizard pops up again.<br>\r
-- Select Install Automatically and click Next. This installs the SRP driver.<br>\r
- </p>\r
-\r
-<h2><u>Known Issues</u></h2>\r
-\r
-<ul>\r
- <li>\r
- <p class=MsoPlainText><font face="Times New Roman" size="3">Sometimes an \r
- errant "Welcome to the Found New Hardware Wizard" window pops up during \r
- InfiniBand device installation.<br>\r
- Just 'cancel' the FNHW popup window and proceed with installation.<br>\r
- An artifact of the 'Cancel' operation may cause a taskbar Information bubble \r
- to appear which incorrectly claims problems with the Infiniband device \r
- installation; Check IB device status via the Device Manager.<br>\r
- Microsoft claims this behavior is resultant from installation of non-signed \r
- device drivers coupled with the IB fabric coinstaller.<br> </font></p></li>\r
- <li>\r
- <p class=MsoPlainText><font face="Times New Roman" size="3">The latest round of MS patches to Window Server 2003 (R2) contain the WSD \r
- hotfix.<br>\r
- <br>\r
- The Windows \r
- OpenFabrics release includes a WSD provider library that has been \r
- extensively tested with Microsoft Windows Server 2003.<br>\r
- During testing, bugs where found in the WSD switch that could lead to hangs, \r
- crashes, data corruption, and other unwanted behavior. Microsoft released a \r
- hotfix to address these issues which should be installed if using WSD.<br>\r
- The Microsoft Windows Server 2003 hotfix for WSD can be located\r
- <a class="wiki" href="http://support.microsoft.com/?kbid=910481">here</a>.<br>\r
- </font><br> <font face="Times New Roman" size="3"><br> </font></p></li>\r
-</ul>\r
-<p class=MsoPlainText><br>\r
- </p>\r
-<p class=MsoPlainText> </p>\r
-\r
-</div>\r
-\r
-</body>\r
-\r
-</html>\r