From e30e91589bf9ac4cb0338620db1ba8cba1aeee13 Mon Sep 17 00:00:00 2001 From: stansmith Date: Thu, 12 Jul 2007 22:00:57 +0000 Subject: [PATCH] [WinOF] updated with SRP info git-svn-id: svn://openib.tc.cornell.edu/gen1@742 ad392aa1-c5ef-ae45-8dd8-e69d62a5ef86 --- branches/WinOF/InstallShield/Manual.htm | 162 ++++++++++++++++++++++-- 1 file changed, 148 insertions(+), 14 deletions(-) diff --git a/branches/WinOF/InstallShield/Manual.htm b/branches/WinOF/InstallShield/Manual.htm index 71e7fcf1..2f3535b2 100644 --- a/branches/WinOF/InstallShield/Manual.htm +++ b/branches/WinOF/InstallShield/Manual.htm @@ -15,7 +15,7 @@ div.Section1

User's Manual

Release 1.0

-06/27/2007

+07/12/2007

Overview

The Windows OpenFabrics (WinOF) package is composed of software modules intended @@ -138,11 +138,11 @@ Display HCA attributes, statistics and error counters.
 

 

 

-

 

-

User mode verbs micro-benchmarks
- 

-

These micro-benchmarks tests are intended as useful benchmarks for HW or SW +

User mode micro-benchmarks

+
+

The following user-mode test programs are intended as useful +micro-benchmarks for HW or SW tuning and/or functional testing.

Tests use CPU cycle counters to get time stamps without @@ -272,6 +272,10 @@ transactions


 

ttcp - Test TCP performance

+

TTCP accesses the Windows socket layer, hence it does not access +IB verbs directly. IPoIB or WSD layers are invoked beneath the socket layer +depending on configuration. TTCP is included as a quick baseline performance +check.

Usage: ttcp -t [-options] host 
        ttcp -r [-options]
@@ -301,6 +305,7 @@ Options specific to -r:
 
 

 
 

 
Diagnostics

+

 
 

 
ib_limits - Infiniband verbs tests

 
Usage: ib_limits [options]

@@ -368,6 +373,7 @@ Options specific to -r:
 
<return-to-top>

 
 

 
Subnet Management with OpenSM Rev: openib-1.2.0

+

 
A single running process (opensm.exe) is required to configure 
 and thus make an Infiniband subnet useable.  For most cases, InfiniBand 
 Subnet Management as a Windows service is sufficient to correctly configure most 
@@ -393,7 +399,6 @@ Management service.

 	Management service status via the Windows service manager (see #1).
 
 
 

-

 
Manual InfiniBand Subnet Management from a command window

 
Usage: opensm.exe [options]

 
Options:

@@ -850,6 +855,7 @@ Options: one of the following optional flows:

 
 

 
 

 
IPoIB - Internet Protocols over InfiniBand

+

 
IPoIB enables the use of Internet Protocol utilities (e.g., ftp, 
 telnet) to function correctly over an Infiniband fabric. IPoIB is implemented as 
 an NDIS Miniport driver with a WDM lower edge.

@@ -871,6 +877,7 @@ the Local Area Connection to be disabled, then likely your subnet manager
 
 

 
 

 
Winsock Direct Service Provider

+

 
Winsock Direct (WSD) is Microsoft's proprietary protocol that 
 predates SDP (Sockets Direct Protocol) for accelerating TCP/IP applications by 
 using RDMA hardware. Microsoft had a significant role in defining the SDP 
@@ -883,14 +890,21 @@ Windows Server 2003, and is responsible for routing socket traffic over either
 the regular TCP/IP stack, or offload it to a WSD provider. The WSD provider is a 
 hardware specific DLL that implements connection management and data transfers 
 over particular RDMA hardware.

+
WinOF WSD is not supported in the Windows XP environment.

 
The WSD Protocol seamlessly transports TCP 
 		data using Infiniband data packets in 'buffered' mode or Infiniband 
 		RDMA in 'direct' mode. Either way the user mode socket application sees no 
-		difference in the standard Inet socket which it created other than 
+		behavioral difference in the standard Internet Protocol socket it created other than 
 reduced data transfer times and increased bandwidth.

 

 The Windows OpenFabrics release includes a WSD provider library that has been 
-extensively tested with Microsoft Windows Server 2003.

+extensively tested with Microsoft Windows Server 2003.

+During testing, bugs where found in the WSD switch that could lead to hangs, 
+crashes, data corruption, and other unwanted behavior. Microsoft released a 
+hotfix to address these issues which should be installed if using WSD; the 
+Microsoft Windows Server 2003 hotfix can be found
+here.

+ 

 

 	

 		
@@ -955,7 +969,7 @@ extensively tested with Microsoft Windows Server 2003.

-								
+								
@@ -1028,7 +1042,7 @@ extensively tested with Microsoft Windows Server 2003.

 See 
 https://wiki.openfabrics.org/tiki-index.php?page=Winsock+Direct for the 
 latest WSD status.

-
Install Winsock Direct Service Provider

+
Winsock Direct Service Provider Installation
When the custom install option 'WSD' is selected the WSD service 
 is automatically installed and started as part of the installation.

 Manual control is performed via the \Program Files\WinOF\installsp.exe utility.

@@ -1044,11 +1058,84 @@ Manual control is performed via the \Program Files\WinOF\installsp.exe utility.<
 
<return-to-top>
 
 

-
Direct Access Transport and usermode Direct Access Programing 
+
Direct Access Transport and usermode Direct Access Programming 
 Libraries

-
DAT and uDAPL are based on the 1.1 DAT specification. The DAPL 
-(Direct Access Provider Library) provider now fully supports Infiniband RDMA and 
+

+
The DAT (Direct Access Transport) 
+API is a C programming interface developed by the
+DAT Collaborative in 
+order provide a set of transport-independent, platform-independent Application 
+Programming Interfaces that exploit the RDMA (remote direct memory access) 
+capabilities of next-generation interconnect technologies such as InfiniBand, 
+and iWARP.

+
WinOF DAT and uDAPL are based on the 1.1 DAT specification. The DAPL 
+(Direct Access Provider Library) now fully supports Infiniband RDMA and 
 IPoIB.

+

+	

+		

 							
 							

 								0x00000040CMCM (Connection Manager)
 							

 							

 								0x00000080
 
 
 

+			
+				
+			
+		

+				

+					

+						

+						How  DAT objects map to equivalent
+						
+						InfiniBand objects:

+ 
+							
+								
+								
+							
+							
+								
+								
+							
+							
+								
+								
+							
+							
+								
+								
+							
+							
+								
+								
+							
+							
+								
+								
+							
+							
+								
+								
+							
+							
+								
+								
+							
+							
+								
+								
+							
+						
Interface Adapter (IA) 
+								HCA (Host Channel Adapter)
Protection Zone (PZ) PD (Protection Domain)
Local Memory Region (LMR) 
+								MR (Memory Region)
Remote Memory Region (RMR) 
+								MW (Memory Windows)
Event Dispatcher (EVD) 
+								CQ (Completion Queue)
Endpoint (EP) QP (Queue Pair)
Public Service Point (PSP) 
+								connection identifier 
Reserved Service Point (RSP) 
+								connection identifier 
Connection Request (CR) 
+								connection manager event 
+								

+					

+				

+				

+	

+

+
 

 

 	
DAT EXECUTION ENVIRONMENT:

 

@@ -1466,5 +1553,52 @@ BUGS  (and  To Do List)
 
 

 
 

 
SRP - SCSI RDMA Protocol

-
[ADD text here]

+

+The
+SCSI RDMA 
+Protocol  (SRP) is an emerging industry standard protocol for utilizing 
+block storage devices over an InfiniBand™ fabric. SRP is being defined in the 
+ANSI T-10 committee.

+
WinOF SRP is a storage 
+driver implementation that enables the SCSI RDMA protocol over an InfiniBand 
+fabric.

+The implementation conforms
+to the T10 Working Group draft
+
+http://www.t10.org/ftp/t10/drafts/srp/srp-r16a.pdf.

+
Software Dependencies

+
The SRP driver depends on the installation of the WinOF stack 
+with a Subnet

+Manager running somewhere on the IB fabric.

+

+- Supported Operating Systems and Service Packs:

+   o Windows XP SP2 x64

+   o Windows Server 2003 SP1 (x86, x64)

+   o Windows Server 2003 CCS (x64)

+


+Testing Level

+
The SRP driver has undergone basic testing against Mellanox 
+Technologies'

+SRP Targets MTD1000 and MTD2000. Testing included format, read, and write

+operations.

+ 

+
Installation

+
The WinOF stack  does not install the SRP driver by default. 
+If SRP is
+selected in the custom installation window, it will only be copied during WinOF
+installation. To complete the SRP driver installation, an SRP target must be
+detected; a Subnet Manager must be running somewhere in the IB subnet.

+

+Upon the detection of an SRP target, the "New Hardware Found" Wizard pops up.

+- Select Install Automatically and click Next. This installs the I/O unit 
+device.

+

+Once completed, the "New Hardware Found" Wizard pops up again.

+- Select Install Automatically and click Next. This installs the SRP driver.

+ 

+
New Features and Changes

+
- SRP supports WPP tracing tools by using the GUID: 
+'5AF07B3C-D119-4233-9C81-C07EF481CBE6'.

+  The flags and level of debug can be controlled at load-time or run-time.

+ 

 
<return-to-top>

-- 
2.41.0