<h1 align=center style='text-align:center'><a name="1.1_Release_Notes">2.0 Release Notes</a></h1>\r
\r
<h3 align=center style='text-align:center'>\r
-<!--webbot bot="Timestamp" S-Type="EDITED" S-Format="%m/%d/%Y" startspan -->08/29/2008<!--webbot bot="Timestamp" endspan i-checksum="12668" --></h3>\r
+<!--webbot bot="Timestamp" S-Type="EDITED" S-Format="%m/%d/%Y" startspan -->09/09/2008<!--webbot bot="Timestamp" endspan i-checksum="12654" --></h3>\r
\r
<div class=MsoNormal align=center style='text-align:center'>\r
\r
<p class=MsoPlainText><span style='font-size:12.0pt;font-family:"Times New Roman"'> Binary\r
files generated from the OpenIB-windows developers subversion (svn) source tree </span>\r
'svn://openib.tc.cornell.edu'<span style='font-size:12.0pt;font-family:"Times New Roman"'> \r
-(branches\WOF2-0 svn revision <font color="#FF0000">1535</font>)\r
+(branches\WOF2-0 svn revision <font color="#FF0000">1578</font>)\r
are packaged into a <a href="http://www.dalun.com/wix/default.htm">WIX 2.0 \r
(Windows Installer Xml)</a> single file install package referred to as the \r
Windows OpenFabrics (WinOF) release 2.0.<br>\r
<li>WinOF 1.0.1 is based on openib-windows <b><u>svn revision 864</u></b>.<br>\r
</li>\r
<li>WinOF 1.1 is based on openib-windows <b><u>\r
- (branches\WOF1-1) svn revision 1177.<br>\r
+ (svn revision 1177 branches\WOF1-1).<br>\r
</u></b></li>\r
- <li>WinOF 2.0 is based on<b> (<u>svn.1535 branches\WOF2-0</u>)</b></li>\r
+ <li>WinOF 2.0 is based on<b> (<u>svn.1578 branches\WOF2-0</u>)</b></li>\r
</ul>\r
<p><a href="#1.1_Release_Notes"><font color="#000000"><Return-to-Top></font></a></p>\r
<p> </p>\r
<a href="#TOP"></a> </h1>\r
<h1 align="center">Windows OpenFabrics </h1>\r
<h1 align="center">User's Manual</h1>\r
-<h2 align="center">Release 1.1</h2>\r
+<h2 align="center">Release 2.0</h2>\r
<h3 align="center">\r
-<!--webbot bot="Timestamp" S-Type="EDITED" S-Format="%m/%d/%Y" startspan -->04/28/2008<!--webbot bot="Timestamp" endspan i-checksum="12644" --></h3>\r
+<!--webbot bot="Timestamp" S-Type="EDITED" S-Format="%m/%d/%Y" startspan -->09/08/2008<!--webbot bot="Timestamp" endspan i-checksum="12638" --></h3>\r
<h2 align="left"><u>Overview</u></h2>\r
<p align="left"><span style="FONT-SIZE: 12pt; FONT-FAMILY: 'Times New Roman'">\r
The Windows OpenFabrics (WinOF) package is composed of software modules intended \r
<p align="left">HCA (Host Channel Adapter) driver </li>\r
<li>\r
<p style="text-indent: -.25in; margin-left: .5in"><span dir="LTR">MTHCA -<span style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll'> \r
- Mellanox </span></span><st1:stockticker>\r
- <span\r
- style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll'>HCA</span></st1:stockticker><span\r
-style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll'> low level driver. See \r
+ Mellanox </span></span><span style='background-position: 0% 0%; mso-highlight:yellow; background-image:none; background-repeat:repeat; background-attachment:scroll'> \r
+ InfiniHost low level driver. See \r
Release_notes.htm for a list of supported devices.</span></li>\r
<li>\r
<p style="text-indent: -.25in; margin-left: .5in">\r
<li>\r
<p align="left">Infiniband Core modules: IB verbs and IB access layer</li>\r
<li>\r
-<p align="left">Upper Layer Protocols: IPoIB, WSD, VNIC, SRP Initiator and uDAPL</li>\r
+<p align="left">Upper Layer Protocols: IPoIB, WSD, Network Direct, VNIC, SRP Initiator and uDAPL</li>\r
</ul>\r
<p align="left">OpenFabrics utilities:</p>\r
<ul>\r
</h3>\r
</li>\r
<li>\r
- <h3 align="left"><a href="#winsockdirect">Winsock Direct Service Provider</a><br>\r
- </h3>\r
+ <h3 align="left"><a href="#winsockdirect">Winsock Direct Service Provider</a></h3>\r
+ </li>\r
+ <li>\r
+ <h3 align="left"><a href="#Network_Direct_Service_Provider">Network Direct \r
+ Service Provider</a></h3>\r
</li>\r
<li>\r
<h3 align="left"><a href="#DAT">DAT and uDAPL</a></h3>\r
<li>\r
<h3 align="left"><u><a href="#InfiniBand_Software_Development_Kit">\r
InfiniBand Software Development Kit</a></u></h3></li>\r
+ <li>\r
+ <h3 align="left"><a href="#WinVerbs">WinVerbs</a></h3></li>\r
</ul>\r
<h3 align="left"> </h3>\r
<p align="left"> </p>\r
<p align="left"><a href="#opensm">opensm</a> Open Subnet \r
Management - configure and manage an InfiniBand subnet</li>\r
<li>\r
- <p align="left"><a href="#osmtest">osmtest</a> \r
- Subnet management tests</li>\r
+ <p align="left"><a href="#InfiniBand_Partition_Management">part_man</a> \r
+ Manage (add/remove/display) Infiniband fabric partitions.</li>\r
+ <li>\r
+ <p align="left"><a href="#osmtest">osmtest</a> Subnet management tests</li>\r
<li>\r
<p align="left"><a href="#ibtrapgen">ib_trapgen</a> Generate Infiniband Subnet \r
Management Traps for testing purposes</li>\r
an Internet Protocol address associated with an IB GUID.</li>\r
<li>\r
<p align="left"><a href="#vstat">vstat</a> \r
-Display HCA attributes (lids), statistics and error counters.<br> </li>\r
+ Display HCA attributes (lids), statistics and error counters.<br> </li>\r
</ul>\r
</blockquote>\r
</blockquote>\r
</blockquote>\r
<h4 align="left"><a href="#TOP"><font color="#000000"><return-to-top></font></a></h4>\r
<p align="left"> </p>\r
+<h3 align="left"><a name="InfiniBand_Partition_Management">InfiniBand Partition \r
+Management</a></h3>\r
+<p align="left"><font face="Times New Roman">The part</font><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt">_man.exe \r
+application allows creating, deleting and viewing partitions existing on host.</span></font></p>\r
+<p align="left"> </p>\r
+<p align="left"><b><a href="#TOP"><font color="#000000"><return-to-top></font></a></b></p>\r
<p align="left"> </p>\r
<h3 align="left"><a name="printip"></a>PrintIP - print ip adapters and their addresses</h3>\r
<blockquote>\r
</blockquote>\r
<h4 align="left"><a href="#TOP"><font color="#000000"><return-to-top></font></a></h4>\r
<p align="left"> </p>\r
+<h2 align="left"><a name="Network_Direct_Service_Provider">Network Direct \r
+Service Provider</a></h2><hr>\r
+<p align="left"> </p>\r
+<h3 align="left">Network Direct Service Provider Installation</h3>\r
+<p align="left">ND service \r
+is automatically installed and started as part of the 'default' installation for \r
+Windows server 2008, Vista or HPC systems.<br>\r
+Manual control is performed via the \Program Files\WinOF\ndinstall.exe utility.</p>\r
+<blockquote>\r
+ <p align="left">usage: ndinstall [-i | -r | -l]<br>\r
+ <br>\r
+ -i Install (enable) the Network Direct (ND) service provider<br>\r
+ -r Remove the ND service provider<br>\r
+ -r <name> Remove the specified service provider<br>\r
+ -l List service providers<br>\r
+ </p>\r
+</blockquote>\r
+<p align="left"> </p>\r
+<p align="left"><b><a href="#TOP"><font color="#000000"><return-to-top></font></a></b></p>\r
<p align="left"> </p>\r
<h2 align="left"><a name="DAT"></a>Usermode Direct Access Transport and Direct Access Programming \r
Libraries</h2>\r
\r
<p align="left"> </p>\r
<p align="left"><a href="#TOP"><font color="#000000"><<b>return-to-top</b>></font></a></p>\r
-<p> </p>\r
+<p align="left"> </p>\r
+<h2><a name="WinVerbs">WinVerbs</a></h2><hr>\r
+<p><br>WinVerbs is a userspace verbs and communication management interface optimized<br>for the Windows operating system. Its lower interface is designed to support<br>any RDMA based device, including Infiniband and iWarp. Its upper interface is<br>capable of providing a low latency verbs interface, plus supports Microsoft's<br>Network Direct Interface, DAPL, and OFED libibverbs interfaces. It consists of<br>a userspace library and a kernel filter driver.<br>\r
+<br>The WinVerbs driver loads as an upper filter driver for Infiniband controllers.<br>(Open source iWarp drivers for Windows are not yet available.) A corresponding<br>userspace library installs as part of the Winverbs driver installation package.<br>Additionally, a Windows port of the OFED libibverbs library and several test<br>programs are also included.<br>\r
+<br>A full list of available libibverbs test programs and their usage are given<br>below. Note that not all listed options apply to all applications<br>\r
+<br>ibv_devinfo<br>-d <dev> use IB device <dev> (default first device found)<br>-I <port> use port <port> of IB device (default all ports)<br>-l print only the IB devices names<br>-v print all the attributes of the IB device(s)<br>\r
+<br>ibv_rc_pingpong, ibv_uc_pingpong, ibv_ud_pingpong<br>no args start a server and wait for connection<br>-h <host> connect to server at <host><br>-p <port> listen on/connect to port <port> (default 18515)<br>-d <dev> use IB device <dev> (default first device found)<br>-i <port> use port <port> of IB device (default 1)<br>-s <size> size of message to exchange (default 4096)<br>-m <size> path MTU (default 1024)<br>-r <dep> number of receives to post at a time (default 500)<br>-n <iters> number of exchanges (default 1000)<br>-l <sl> service level value<br>-e sleep on CQ events (default poll)<br>\r
+<br>ibv_send_bw, ibv_send_lat<br>ibv_read_bw, ibv_read_lat<br>ibv_write_bw, ibv_write_lat<br>no args start a server and wait for connection<br>-h <host> connect to server at <host><br>-p <port> listen on/connect to port <port> (default 18515)<br>-d <dev> use IB device <dev> (default first device found)<br>-i <port> use port <port> of IB device (default 1)<br>-c <RC/UC/UD> connection type RC/UC/UD (default RC)<br>-m <mtu> mtu size (256 - 4096. default for hermon is 2048)<br>-s <size> size of message to exchange (default 65536)<br>-a Run sizes from 2 till 2^23<br>-t <dep> size of tx queue (default 300)<br>-g send messages to multicast group (UD only)<br>-r <dep> make rx queue bigger than tx (default 600)<br>-n <iters> number of exchanges (at least 2, default 1000)<br>-I <size> max size of message to be sent in inline mode (default 400)<br>-b measure bidirectional bandwidth (default unidirectional)<br>-V display version number<br>-e sleep on CQ events (default poll)<br>-N cancel peak-bw calculation (default with peak-bw)<br>\r
+<br>To verify correct WinVerbs and libibverbs installation, run ibv_devinfo. It<br>should report all RDMA devices in the system, along with limited port<br>attributes. Because of limitations in the WinOF stack, it is normal for it to<br>list several values as unknown.</p>\r
+<p><a href="#TOP"><font color="#000000"><<b>return-to-top</b>></font></a></p>\r
\r
\r