<h1 align="center">User's Manual</h1>\r
<h2 align="center">Release 2.0</h2>\r
<h3 align="center">\r
-<!--webbot bot="Timestamp" S-Type="EDITED" S-Format="%m/%d/%Y" startspan -->10/22/2008<!--webbot bot="Timestamp" endspan i-checksum="12541" --></h3>\r
+<!--webbot bot="Timestamp" S-Type="EDITED" S-Format="%m/%d/%Y" startspan -->12/23/2008<!--webbot bot="Timestamp" endspan i-checksum="12561" --></h3>\r
<h2 align="left"><u>Overview</u></h2>\r
<p align="left"><span style="FONT-SIZE: 12pt; FONT-FAMILY: 'Times New Roman'">\r
The Windows OpenFabrics (WinOF) package is composed of software modules intended \r
</ul>\r
<h4 align="left"><a href="#diags">Diagnostics</a></h4>\r
<ul>\r
+ <li>\r
+ <p align="left"><a href="#ibstat">ibstat</a> \r
+ Display HCA stats.</li>\r
+ <li>\r
+ <p align="left"><a href="#ibv_devinfo">ibv_devinfo</a> \r
+ Display HCA device information.</li>\r
+ <li>\r
+ <p align="left"><a href="#vstat">vstat</a> Display HCA attributes (lids), statistics and error counters.</li>\r
<li>\r
<p align="left"><a href="#iblimits">ib_limits</a> \r
Infiniband verb tests</li>\r
<li>\r
<p align="left"><a href="#printip">PrintIP</a> Display \r
an Internet Protocol address associated with an IB GUID.</li>\r
- <li>\r
- <p align="left"><a href="#vstat">vstat</a> Display HCA attributes (lids), statistics and error counters.<br> </li>\r
</ul>\r
</blockquote>\r
</blockquote>\r
<br>"-H" option will dump the histogram for additional statistical analysis.<br>See xgraph, ygraph, r-base (http://www.r-project.org/), pspp, or other\r
<br>statistical math programs.<br><br>Architectures tested: x86, x86_64, ia64</p>\r
</blockquote>\r
-<h4 align="left"><a name="ibsend_lat"></a>ib_send_lat.exe - latency test with \r
+<h4 align="left"><a name="ibsend_lat"></a><br>\r
+ib_send_lat.exe - latency test with \r
send transactions</h4>\r
<blockquote>\r
<p align="left">Usage:</p>\r
-e, --events sleep on CQ events (default poll)</p>\r
</blockquote>\r
</blockquote>\r
-<h4 align="left"><a name="ibsend_bw"></a>ib_send_bw.exe - BW (BandWidth) test with send transactions</h4>\r
+<h4 align="left"><a name="ibsend_bw"></a><br>\r
+ib_send_bw.exe - BW (BandWidth) test with send transactions</h4>\r
<blockquote>\r
<p align="left">Usage:</p>\r
<blockquote>\r
-e, --events sleep on CQ events (default poll)</p>\r
</blockquote>\r
</blockquote>\r
-<h4 align="left"><a name="ibwrite_lat"></a>ib_write_lat.exe - latency test with RDMA write \r
+<h4 align="left"><a name="ibwrite_lat"></a><br>\r
+ib_write_lat.exe - latency test with RDMA write \r
transactions</h4>\r
<blockquote>\r
<p align="left">Usage:</p>\r
-V, --version display version number</p>\r
</blockquote>\r
</blockquote>\r
-<h4 align="left"><a name="ibwrite_bw"></a>ib_write_bw.exe - BW test with RDMA write transactions</h4>\r
+<h4 align="left"><a name="ibwrite_bw"></a><br>\r
+ib_write_bw.exe - BW test with RDMA write transactions</h4>\r
<blockquote>\r
<p align="left">Usage:</p>\r
<blockquote>\r
<h4 align="left"><a href="#TOP"><font color="#000000"><return-to-top></font></a></h4>\r
<p align="left"><br>\r
</p>\r
-<h4 align="left"><a name="ttcp"></a>ttcp - Test TCP performance</h4>\r
+<h4 align="left"><a name="ttcp"></a><br>\r
+ttcp - Test TCP performance</h4>\r
<p align="left">TTCP accesses the Windows socket layer, hence it does not access \r
IB verbs directly. IPoIB or WSD layers are invoked beneath the socket layer \r
depending on configuration. TTCP is included as a quick baseline performance \r
<p align="left"> </p>\r
<h2 align="left"><a name="diags"></a>Diagnostics</h2>\r
<hr>\r
-<p align="left"> </p>\r
-<h3 align="left"><a name="iblimits"></a>ib_limits - Infiniband verbs tests</h3>\r
+<h3 align="left"><a name="ibv_devinfo"></a><br>\r
+ibv_devinfo - print CA (Channel Adapter) attributes</h3>\r
+<p align="left">usage: ibv_devinfo [options]<br>\r
+<br>\r
+Options:<br>\r
+ -d, --ib-dev=<dev> use IB device <dev> (default: first device \r
+found)<br>\r
+ -i, --ib-port=<port> use port <port> of IB device (default: \r
+all ports)<br>\r
+ -l, --list print only the IB devices names<br>\r
+ -v, --verbose print all the attributes of the IB device(s)<br>\r
+<br>\r
+<font color="#000000"><a href="#TOP"><return-to-top></a></font><br>\r
+ </p>\r
+<h3 align="left"><a name="ibstat"></a><br>\r
+ibstat - print InfiniBand stats</h3>\r
+<p align="left">usage: ibstat [OPTIONS] <ca_name> [portnum]<br>\r
+<br>\r
+Options:<br>\r
+ -d debug<br>\r
+ -l list all IB devices<br>\r
+ -s print short device summary<br>\r
+ -p print port GUIDs<br>\r
+ -V print ibstat version information and exit<br>\r
+ -h print usage<br>\r
+<br>\r
+Examples:<br>\r
+ ibstat -l # list all IB devices<br>\r
+ ibstat mthca0 2 # stat port 2 of mthca0<br>\r
+<br>\r
+<font color="#000000"><a href="#TOP"><return-to-top></a></font><br>\r
+ </p>\r
+<h3 align="left"><a name="iblimits"></a><br>\r
+ib_limits - Infiniband verbs tests</h3>\r
<p align="left">Usage: ib_limits [options]</p>\r
<blockquote>\r
<p align="left">Options:<br>-m or --memory<br> Direct ib_limits to test memory registration<br>-c or --cq<br> Direct ib_limits to test CQ creation<br>-r or --resize_cq<br> direct ib_limits to test CQ resize<br>-q or --qp<br> Directs ib_limits to test QP creation<br>-v or --verbose<br> Enable verbosity level to debug console.<br>-h or --help<br> Display this usage info then exit.</p>\r
</blockquote>\r
<h4 align="left"><a href="#TOP"><font color="#000000"><return-to-top></font></a></h4>\r
<p align="left"> </p>\r
-<h3 align="left"><a name="cmtest"></a>cmtest - Connection Manager Tests</h3>\r
+<h3 align="left"><a name="cmtest"></a><br>\r
+cmtest - Connection Manager Tests</h3>\r
<p>Usage: cmtest [options]</p>\r
<p> Options:</p>\r
<blockquote>\r
\r
<p align="left"><b><a href="#TOP"><font color="#000000"><return-to-top></font></a></b></p>\r
<p align="left"> </p>\r
-<h3 align="left"><a name="printip"></a>PrintIP - print ip adapters and their addresses</h3>\r
+<h3 align="left"><a name="printip"></a><br>\r
+PrintIP - print ip adapters and their addresses</h3>\r
<blockquote>\r
<p align="left">PrintIP is used to print IP adapters and their addresses, or \r
ARP (Address Resolution Protocol) and IP address.<br>\r
<p align="left"> </p>\r
<h3 align="left">\r
<br>\r
-<a name="vstat"></a>vstat - HCA Stats and Counters</h3>\r
+<a name="vstat"></a><br>\r
+vstat - HCA Stats and Counters</h3>\r
<blockquote>\r
<p align="left">Display HCA (Host channel Adapter) attributes.</p>\r
<p align="left">Usage: vstat [-v] [-c]<br>\r
</blockquote>\r
<h4 align="left"><a href="#TOP"><font color="#000000"><return-to-top></font></a></h4>\r
<h3 align="left"> </h3>\r
-<h3 align="left"><a name="osmtest"></a>Osmtest - Subnet Management Tests</h3>\r
+<h3 align="left"><a name="osmtest"></a><br>\r
+Osmtest - Subnet Management Tests</h3>\r
<p align="left">Invoke open subnet management tests. osmtest currently can not \r
run on the same HCA port which OpenSM is currently using.</p>\r
<blockquote>\r
<h4 align="left"><a href="#TOP"><font color="#000000"><return-to-top></font></a></h4>\r
<h3 align="left"> </h3>\r
<h3 align="left"><br>\r
-<a name="ibtrapgen"></a>ibtrapgen - Generate Infiniband subnet management traps</h3>\r
+<a name="ibtrapgen"></a><br>\r
+ibtrapgen - Generate Infiniband subnet management traps</h3>\r
<p align="left">Usage: ibtrapgen -t|--trap_num <TRAP_NUM> -n|--number <NUM_TRAP_CREATIONS><br>\r
\r
-r|--rate <TRAP_RATE> -l|--lid <LIDADDR> <br>\r
<h2><a name="WinVerbs">WinVerbs</a></h2><hr>\r
<p><br>WinVerbs is a userspace verbs and communication management interface optimized<br>for the Windows operating system. Its lower interface is designed to support<br>any RDMA based device, including Infiniband and iWarp. Its upper interface is<br>capable of providing a low latency verbs interface, plus supports Microsoft's<br>Network Direct Interface, DAPL, and OFED libibverbs interfaces. It consists of<br>a userspace library and a kernel filter driver.<br>\r
<br>The WinVerbs driver loads as an upper filter driver for Infiniband controllers.<br>(Open source iWarp drivers for Windows are not yet available.) A corresponding<br>userspace library installs as part of the Winverbs driver installation package.<br>Additionally, a Windows port of the OFED libibverbs library and several test<br>programs are also included.<br>\r
-<br>A full list of available libibverbs test programs and their usage are given<br>below. Note that not all listed options apply to all applications<br>\r
-<br>ibv_devinfo<br>-d <dev> use IB device <dev> (default first device found)<br>-I <port> use port <port> of IB device (default all ports)<br>-l print only the IB devices names<br>-v print all the attributes of the IB device(s)<br>\r
+<br>Available libibverbs test programs and their usage are listed<br>below. Note that not all listed options apply to all applications<br>\r
<br>ibv_rc_pingpong, ibv_uc_pingpong, ibv_ud_pingpong<br>no args start a server and wait for connection<br>-h <host> connect to server at <host><br>-p <port> listen on/connect to port <port> (default 18515)<br>-d <dev> use IB device <dev> (default first device found)<br>-i <port> use port <port> of IB device (default 1)<br>-s <size> size of message to exchange (default 4096)<br>-m <size> path MTU (default 1024)<br>-r <dep> number of receives to post at a time (default 500)<br>-n <iters> number of exchanges (default 1000)<br>-l <sl> service level value<br>-e sleep on CQ events (default poll)<br>\r
<br>ibv_send_bw, ibv_send_lat<br>ibv_read_bw, ibv_read_lat<br>ibv_write_bw, ibv_write_lat<br>no args start a server and wait for connection<br>-h <host> connect to server at <host><br>-p <port> listen on/connect to port <port> (default 18515)<br>-d <dev> use IB device <dev> (default first device found)<br>-i <port> use port <port> of IB device (default 1)<br>-c <RC/UC/UD> connection type RC/UC/UD (default RC)<br>-m <mtu> mtu size (256 - 4096. default for hermon is 2048)<br>-s <size> size of message to exchange (default 65536)<br>-a Run sizes from 2 till 2^23<br>-t <dep> size of tx queue (default 300)<br>-g send messages to multicast group (UD only)<br>-r <dep> make rx queue bigger than tx (default 600)<br>-n <iters> number of exchanges (at least 2, default 1000)<br>-I <size> max size of message to be sent in inline mode (default 400)<br>-b measure bidirectional bandwidth (default unidirectional)<br>-V display version number<br>-e sleep on CQ events (default poll)<br>-N cancel peak-bw calculation (default with peak-bw)<br>\r
<br>To verify correct WinVerbs and libibverbs installation, run ibv_devinfo. It<br>should report all RDMA devices in the system, along with limited port<br>attributes. Because of limitations in the WinOF stack, it is normal for it to<br>list several values as unknown.</p>\r
projects / ~shefty / rdma-win.git / commitdiff