Professional Documents
Culture Documents
RNA Networks
2
Mission Statement
Unify the cohesive development and testing of interoperable, open-source,
RDMA-enabled, transport independent software stacks that are architected for
high-performance, low-latency, high efficiency and low power use
Sustain integration, distribution and support with mainstream operating systems
Promote widespread understanding, adoption, deployment and benefits of these
solutions for computing, server and storage clustering for performance sensitive
applications through workshops, training and documentation
Manage the interoperability testing and certification of the software running on
different hardware solutions
Capture on-going requirements for improvement and new capabilities from the
end-user, integrator and vendor communities
3
Unified RDMA Services on Converged Networks
Ethernet
E-net
8, 16 or 1 or 10
32 Gbps Gbps4
InfiniBand Fabric Ethernet Network
Windows OpenFabrics (WinOF)
WinOF
Supported Platforms
x86, x86_64, IA64, XP 32&64, Server 2003 – WHQL, CCS 2003 – WHQL, Server 2008, HPC
Server 2008
5
Top500 Performance Trends
Total # of CPUs on the Top500 Total Performance of the Top500
18000
2500 12000
2000 10000
8000
1500
6000
1000 4000
500 2000
0
0
2000 2001 2002 2003 2004 2005 2006 2007 2008
2000 2001 2002 2003 2004 2005 2006 2007 2008
6
Top500 InfiniBand Trends
150
142
Number of Clusters
120
125
90
82
60
30
30
0
50 54
Number of Clusters
40
30
20
10
10
6
0
InfiniBand All Proprietary High
Speed GigEJune 08 Nov 08
Nov 06 June 07 Nov 07
IB + OFED is the only growing high speed interconnect in the Top100
54 clusters, 42% higher than Nov 07 list
More than 5X higher than GigE, 9X higher than all proprietary high
speed interconnects
8
Scalabilty, Power and Efficiency
InfiniBand GigE
9
Other Industry-Wide Usage
Financial
Virtualization
• Reduce latency up to 10X
Database • Predictable data delivery
OLTP • 600K → 10M Messages per second
Data Warehousing • Algorithmic trading, market making,
High Performance Computing quotes, arbitrage
Comparison of IB vs. GigE
10
The OpenFabrics Story
JUN 2004 – founded as OpenIB, IB + Linux only with funding from the U.S.
Department of Energy
DEC 05 – code accepted into Linux Kernel
Spring 2005 – 1st Sonoma w/s, add Windows code
SC 05 – OpenIB SCinet 30+ connections, 3 WAN
Spring 2006 – 2nd Sonoma, add iWARP over Ethernet,
JUN 2006 – OFED 1.0 (OpenFabrics Enterprise Distribution -Linux)
SC 06 – OpenFabrics SCinet includes IB and iWARP
Spring 07?? – 3rd Sonoma Windows 1.0 release (WinOF)
SC 07 -
Spring 08 – 4th Sonoma w/s
SEP 08 – Oracle Introduces Exadata M/C, 2 rail DDR, OFED, HA
SC 08 – 40% Top 10, #1, 3, 6,10,
Spring 2009 - 5th Sonoma w/s, OF software architecture on IEEE DCB
11
How does the Alliance Work?
Developers contribute open-source code
Often sponsored by vendors or end users
In their interest to collaborate on a single robust &
high performance stack
Elected Officers and Working Group volunteers
Chairman, Vice Chairman, Treasurer, Secretary and
Working Group Chairs
Open contributions and participation from the
industry (both technical and marketing)
Marketing and promotion through industry
events, tradeshows, press releases and end-
user interaction
12
Licensing and Development
14
OpenFabrics Alliance (OFA)
Role
Specifications Open Source Development
Community Linux
Distributions
Kernel Drivers, core kernel,
Development middleware and user
level interfaces Used by
Microsoft End
Windows Users
Drivers, core kernel,
Protocols middleware and user
(iSER, NFSoRDMA, uDAPL, etc.) level interfaces
iWARP Industry
Market Development,
(RDMA over Ethernet) Promotion, Education
Peripheral
Support, etc.
University of New Hampshire
UNH IOL
Interoperability
Certification
15
Transport Independence
Applications Scientific, Enterprise Web or Grid
Applications and Services
OEM value
added
OEM value software
added
software Server with File Storage Target with HCA
HCA or R-NIC or R-NIC (NFS-RDMA)
IB-Ethernet Gateway (Future)
OEM value
added
software
OEM value
IB-FC Gateway added
software
IB Switches
17
Linux OFED Components
OFA Add on
Development
HCA/NIC Drivers Bonding module
IB: IBM, Mellanox, QLogic Open iSCSI
iWARP: Chelsio, Intel
MPI Components
Core: Verbs, mad, SMA, CM, CMA MVAPICH
IPoIB Open MPI
SDP MVAPICH2
SRP and SRP Target Benchmark tests
iSER and iSER Target
RDS
Tested
NFS-RDMA with
Proprietary MPIs: Intel, HP
Qlogic_VNIC Proprietary SMs: Cisco, Voltaire,
uDAPL Qlogic
OSM
Diagnostic tools
18
OFED Status and Futures
19
OFED 1.4 OS Matrix
kernel.org: kernel 2.6.26 and 2.6.27
Novell
SLES 10
SLES 10 SP1 (up1)
SLES 10 SP2
Redhat
RHEL 4 (up4, up5, up6, up7)
RHEL 5 (up1, up2)
Oracle Enterprise Linux
OEL 5
Free distros (with limited QA):
Open SuSE 10.3
Fedora Core 9
Ubuntu 6.06 (with RPM package installed)
CentOS 5.2
20
2009 OFED 1.4.1
21
OFED 1.5 Features Plans
Preliminary Schedule
Development tree opened when 2.6.30-rc1is available
People can start development now against 2.6.29 Linux
kernel
Feature Freeze: May 7, 09
Alpha Release: May 12, 09
Beta Release: Jun 9, 09
RC1: Jun 25, 09
RC2-RCx: About every 2 weeks as needed
We usually have ~6 RCs
Release: Sep 15, 09
24
What is an RC?
25
How to contribute?
Developing new code and features
Bug fixes
Performance tuning
Contribute backports for new OSes
Doing QA and testing
Sending patches and comments to the mailing lists:
ewg@lists.openfabrics.org – OFED specific only
general@lists.openfabrics.org – General development
Opening bugs in Bugzilla (https://bugs.openfabrics.org/)
When opening a new bug you should choose OpenFabrics Linux
Old bugs must be tested with new releases and updated on bugzilla
Participate in EWG bi-weekly meetings
Meeting minutes on the web
26
Benefits of Membership
Understand latest development status and
schedules
Influence the development of capabilities and
features you need recognized and prioritized
Association with marketing efforts
Press releases, tradeshows, speaking opportunities,
workshops
Interaction with industry thought leaders
If your organization is using or is interested
in using RDMA-enabled fabric technology,
please talk to me after
27
Four Membership Levels
Promoters ($5000/year, $3000 initiation)
Organizations and enterprises that wish to strongly influence the process and
features in software created and the accompanying promotional activities to
enhance the code they use or provide
Adopters ($3000/year, $3000 initiation)
Organizations and enterprises that wish to contribute to and participate in the
processes and work of the promoters but do not feel the need to strongly affect
the outcomes
Supporters ($1000/year, $3000 initiation)
Organizations and enterprises that wish to use the OpenFabrics software,
leverage the promotional activities, be tied into the work of the Alliance but not
necessarily contribute
Consulting (Free)
Organizations and individuals that the Alliance selects for honorary membership
on an annual basis based on the perceived value of their membership to the
Alliance
Key Contacts
Jim Ryan Chair – jim.ryan@intel.com
Bill Boas, Vice Chair – bboas@systemfabricworks.com
Johann George, Treasurer – johann@georgex.org
Wayne Augsburger – Marketing Chair – wayne@mellanox.com
To join the Alliance review Bylaws and sign Membership
Agreement
Available for download at www.openfabrics.org
Return agreement to the Chair
Pay membership fee to the Treasurer
Start attending monthly promoters meetings and working
group meetings and contribute as appropriate
29
Summary
30