In this lecture and workshop course attendees will gain an understanding of the InfiniBand specification and learn what is involved beyond the specification to implement InfiniBand technology. This course provides an insight into InfiniBand that will enable the InfiniBand Designer, Developer and Implementer to understand the specification, to learn how applications fit into the broader InfiniBand solution, and to design an InfiniBand environment that will grow as the technology matures.

• Use the InfiniBand Architecture specification
• The InfiniBand Architecture specification affects components, implementations and management
• Identify InfiniBand I/O device design requirements
• Evaluate the InfiniBand software interface
• Understand Host Channel Adapters and Target Channel Adaptors.
• Tackle InfiniBand sub-netting and deployment
• Understand the issues involved with testing and validating InfiniBand design requirements
• Implement InfiniBand Technology through a series of class workshops and protocol trace demos

Demo

Demonstrations using traces captured from IB HCA's and Switches to highlight the importance and use of protocol analyzers for the purpose of troubleshooting, fault analysis and performance analysis, including:

• Trace Analysis
• Troubleshooting and Performance Analysis
• Traffic Analysis

Who Should Attend?

This course is designed to provide a solid foundation on InfiniBand from a specification perspective. This course is designed to provide a foundation in the technology for the InfiniBand module and system designer, test, service and sales engineers, IT Professionals, network managers and anyone who will be involved with designing, maintaining or operating InfiniBand devices and/or networks.

Course attendees must have an understanding of various computer architectures and a general understanding of networking and inter-networking concepts

Course Workshops

This course is designed to allow attendees the opportunity to discuss specifics related to their InfiniBand implementation and requirements. Time is allowed throughout the course for discussion on topics directly related to attendees’ issues and problems. These discussions may include topics such as:

• Evaluating High-End Enterprise Networks with Today's Technology
• Channel Adaptor Design Characteristics
• Header Overhead Analysis
• Designing an Application Interface
• Managing an InfiniBand Fabric
  

Course Prerequisites

Course attendees should have an understanding of the various computer architectures and a general understanding of networking and inter-networking concepts.

InfiniBand Overview

• InfiniBand Overview
• I/O Technology and InfiniBand
• Existing Networks
  • LANs and WANs
  • Current Network Design Trends
  • Data Requirements
• InfiniBand System Area Network (SAN)
  • InfiniBand Architecture
• InfiniBand Trade Association
  • InfiniBand by Definition
  • Governance Board
• InfiniBand Benefits
  • Switched Fabric
  • Scaleable
  • Management
  • Integration into Existing Systems

• InfiniBand Architecture
  • Layered Protocol Architecture
  • Fabric
    
• InfiniBand Fabric
  • Devices
  • Addressing, Subneting, and Routing
  • InfiniBand Channel
  • Reason for and Types of Service Levels
  • Fabric Management
  • Comparisons to Existing Technology

• Layered Architecture
  • Consumer
  • Transport Layer
  • Network Layer
  • Link Layer
  • Physical Layer
  • Mapping to Competitive Protocols
• Channel Adapters
  • Characteristics
  • HCA and Usage
  • TCA and Usage
• Inter-Device Communications
  • Queue Pairs
  • Channel Connection
• Congestion Control
  • Flow Control
  • Injection Rate Control
• Service Types
  • Reliable
  • Unreliable
• Switches
• Switch Function
• Switch Characteristics
• Mesh and Alternate Paths
• Routers
  • Router Functions
  • Internet and Intranet Routing
  • Global Routing
• InfiniBand System Network
  • Nodes and Types
  • Subnet Administrator

• Memory Model
  • Shared Memory
  • Domains and Partitions
  • Registration
• Channel and Queue Pairs
  • InfiniBand Queuing Model
• Data Exchange with Consumer
  • DMA and Read/Write Data Transfers
  • Memory Registration
  • Creating Windows
  • Creating Channels
• Protocol Layer Functions
  • Transport Layer
  • Network Layer
  • Link Layer and Point-to-Point

• Consumer Layer
  • Applications
  • Device Drivers
  • Verbs and Messages
• Transport Layer
  • Functions
  • Base Header
  • Transaction Ordering
  • Reliable/Unreliable Connections
  • Packet Header Validation
• Network Layer
  
  • Packet Routing
  • Global Route Headers
• Link Layer
  • Link States
  • Packet Receiver State
  • Packet Checks
  • Virtual Lanes
  • Local Route Header
  • Flow Control
  • Multicast
  • Subnet Multi Path
• Physical Layer
  • Scope
  • Signal Groups
  • Physical Layer Responsibilities
  • Signaling
  • Speed/Width
  • Hardware Management
  • Module Types
  • Power

• Channel Interface
• Verb Consumers
  
• Verb Types and Definitions
• Verb Classes
  • Mandatory vs. Optional
  • Functionality
  • Consumer Accessibility
• Transport Research Management
  • HCA
• Address Management Verbs
  • Queue Pair(s)
  • Special Queue Pair
  • Completion Queue
  • EE Context
  • Memory Management
• Multicast
• Work Request Processing
• Event Handling
• Result Types
• SDP and Verbs
• Verb Consideration

• Management Model
  • Subnet Manager (SM)
  • Subnet Agents (SA) and Interface
• Management Datagrams (MADs)
  • Format/Fields
  • Classes
  • Class Methods
  • Messaging
  • Status Field
  • Class Attributes
    
  • Traps
  • Event Forwarding
• Management Datagram (MAD) Processing
• Subnet Management
  • Format
  • SM Packets and Routing
  • Methods and Keys
  • Attributes
  • SM Agent
• Subnet Administration
  • SA/SM Relationships
  • SA/MADs
  • Reliable Multi-Packet Transport
  • Time Outs
  • Error handling
  • Operations
• General Services
  • GS Model
  • Baseboard management
  • Device management
  • SNMP Tunneling
  • Vendor Specific
  • Applications Specific
  • Communications Management
• Communications Management
  • Establishing Channel

• Current Data Center Design
  • Logical/Physical Deployment
• InfiniBand Deployment Options
  • Dedicated Subnet
  • Shared I/O Interconnect
  • Multiple Subnets
• HCA Characteristics and Issues
  • Mandatory and Optional
  • Memory and Queue Pairs
• TCA Characteristics and Issues
  • I/O Controller
  • I/O Module
• Operating System Characteristics and Issues
• Testing and Validation
• Management Considerations
  • Framework-Based management Packages
  • Stand Alone Management Packages
  • Performance Testing and Monitoring