iSCSI and FCoE for the P6000 EVA family

Technical white paper

Table of contents
Overview ............................................................................................................................................ 2
Introduction to FC, iSCSI, or FCoE ......................................................................................................... 2
Fibre Channel .................................................................................................................................. 2
iSCSI .............................................................................................................................................. 2
FCoE .............................................................................................................................................. 2
P6000 EVA FC, iSCSI, and FCoE options ............................................................................................... 2
HP P6000 EVA Family Dual Controllers .............................................................................................. 3
HP MPX200 Multifunction Router ....................................................................................................... 3
Reasons to use iSCSI ............................................................................................................................ 4
Less expensive SAN ......................................................................................................................... 4
Connection to remote servers ............................................................................................................. 4
Easier and more efficient branch office backups .................................................................................. 5
Virtual machine deployment .............................................................................................................. 6
Mixing 1 Gb and 10 Gb iSCSI ......................................................................................................... 7
High availability .............................................................................................................................. 7
Data migration ................................................................................................................................ 8
Reasons to use FCoE ............................................................................................................................ 8
Reduce network complexity in the data center ..................................................................................... 8
Reduce the number of network interface cards required to connect to disparate storage and IP networks .... 9
Reduce the number of cables and switches .......................................................................................... 9
Reduce power and cooling costs ........................................................................................................ 9
Mixing FC, FCoE, and iSCSI/Ethernet ................................................................................................ 9
FCoE ............................................................................................................................................ 10
Consistent Command View management .............................................................................................. 10
HP interconnect equipment.................................................................................................................. 12
FC ................................................................................................................................................ 12
Ethernet ........................................................................................................................................ 12
FCoE ............................................................................................................................................ 12
Summary .......................................................................................................................................... 13
For more information .......................................................................................................................... 14
 Overview
Fibre Channel (FC) has been a key interface for storage area networks (SAN) for data centers for
some time. It has increased in speed from 1 Gb/s to now up to 8 Gb/s and 10 Gb/s. But Internet
SCSI (iSCSI), first at 1 Gb/s speeds and now at 10 Gb/s speeds, is becoming increasingly important
as an interconnect option for storage systems. And Fibre Channel over Ethernet (FCoE) is now another
important option available as well.
In addition to the MPX200 Multifunction Router, which provides 1 Gb/s iSCSI, FCIP and 10 Gb/s
iSCSI/FCoE options to EVAs, the new P6000 EVA Family Systems have a native 1 Gb/s iSCSI option
and a native 10 Gb/s iSCSI/FCoE option. This white paper will review each option and will also
review what iSCSI and FCoE can offer for HP customers.

Introduction to FC, iSCSI, or FCoE

Fibre Channel
Fibre Channel was devised specifically for performance, reliability, and availability to data. It is the
most costly option and is used primarily for Tier 1 and Tier 2 applications with data residing within
the same data center, due to its distance limitations.

iSCSI
iSCSI is a great option if lower cost connection to data is required and lower speed access to data is
acceptable. iSCSI leverages installed IP networks and offers the ability to reduce cost and complexity
in the storage infrastructure while also spanning unlimited distances, however, it is not optimized for
storage access.

FCoE
Fibre Channel over Ethernet (FCoE) is still emerging, but offers the promise of fast, reliable, and
available access to data with a lower TCO due to the convergence of Ethernet and Fibre Channel
and the various components and management required to maintain two separate infrastructures. FCoE
is often referred to as CEE/FCoE or FCoE/CEE, with CEE (Converged Enhanced Ethernet) being the
version of Ethernet that supports FCoE. Currently 80% of the benefit of FCoE can be enjoyed through
I/O convergence at the server edge. That is, employ new CNA (Converged Network Adapter)-based
technology within the servers, connecting to a CEE/FCoE TOR (top of rack) switch. By doing so,
required components can be reduced by 75-95% at the server, where all the complexity lies, and
connections to existing Ethernet and Fibre Channel infrastructures are retained.

P6000 EVA FC, iSCSI, and FCoE options

The available iSCSI and FCoE connectivity options for EVAs, beginning with the new 1GbE (1 Gb/s
iSCSI) and 10GbE (10 Gb/s iSCSI/FCoE) options for the P6300/P6500 EVAs, are:
 HP P6000 EVA Family Dual Controllers
 HP MPX200 Multifunction Router

2
HP P6000 EVA Family Dual Controllers

Figure 1: P6300 EVA or P6500 EVA Controller

The HP P6300 and P6500 EVA Dual Controllers are available in three basic configurations each:
1. With eight 8 Gb/s FC ports per controller pair
2. With four 8 Gb/s FC ports and eight 1GbE (1 Gbps iSCSI) ports per controller pair
3. With four 8 Gb/s FC ports and four 10GbE (10 Gbps iSCSI/FCoE) ports per controller pair

The controllers are only available in dual redundant configurations, whether they are FC only, or FC
and 1GbE, or FC and 10GbE. The P6300/P6500 controllers occupy just 2U of rack space.
The P6300/P6500 EVA controllers with the 1GbE or 10GbE option save rack space, provide power
savings, are less expensive for a redundant configuration, and have fewer parts than an external
option. And no interconnect cables between the P6300/P6500 EVA controllers and internal
iSCSI/FCoE solutions are required, but they are required with external options. Finally, the power and
cooling are part of the overall controller packaging, so there are fewer parts and power utilization is
more efficient.
For more details on the P6000 EVA Family, visit: www.hp.com/go/P6000

HP MPX200 Multifunction Router

The HP MPX200 Multifunction Router extends the FC SAN investment with integrated multi-protocol
support, allowing customers to incorporate iSCSI servers without requiring additional storage arrays
or management costs. It provides 1 Gbps iSCSI, 1 Gbps FCIP, 10 Gbps iSCSI, and 10 Gbps FCoE
connectivity to servers. It connects to EVAs via 8/4/2 Gbps FC. The MPX200 base package occupies
a full width 2U rack space and can include one 1GbE or one 10–1GbE blade and can support a
second blade in the same package space.
The MPX200 supports all EVAs: EVA3000/5000, EVA4000/6000/8000, EVA4100/6100/8100,
EVA4400/6400/8400, and P6300/P6500 EVAs. An MPX200 can connect up to four EVAs,
reducing the complexity and cost of iSCSI connectivity to multiple EVA storage arrays.
The MPX200 also has FCIP and Data Migration options, to further expand the MPX200 capabilities.

Note:
Command View EVA software cannot support both the MPX200
Multi-protocol Router and the P6300/P6500 FC and iSCSI controllers for
the same EVA.

For more details on the MPX200, visit: www.hp.com/go/MPX200.

3
 Reasons to use iSCSI
Less expensive SAN
FC SANs can be relatively expensive. An iSCSI SAN, especially for smaller customers not needing all
the benefits of a FC SAN, can create a less expensive SAN using iSCSI over Ethernet. Using iSCSI
over Ethernet, customers can create a SAN that connects a number of different servers and can do
data consolidation and make more efficient use of centralized shared storage.

Connection to remote servers

Customers often find that they need to connect servers located some distance away from their main
data center to that data center. iSCSI enables organizations to integrate low-cost Ethernet connected
servers with an EVA storage system by bridging the iSCSI protocol to the Fibre Channel protocol. This
capability allows iSCSI servers to leverage shared SAN resources, improving asset utilization, and
enabling new applications.

Figure 2: Use case—Connecting to remote branch offices via iSCSI

Branch
offices
P6500 Main campus
EVA
data center

4
Easier and more efficient branch office backups
Not only can remote servers or branch offices get access to important data stored in their data centers
by using iSCSI, but it also allows branch offices to use the data centers for their data backup. So,
data center backup equipment and management processes can be employed to backup a number of
branch offices, providing more efficient and consistent backup of important data. This removes a
tedious but important task from branch office personnel, who may not be sufficiently trained for such
tasks, plus it saves the cost of backup equipment at each branch office, the time and effort to manage
the backup at each location, and the backup data is stored in a totally different physical location,
helping to protect against catastrophic failures at the branch office.

Figure 3: Use case—Data backup from branch offices to main campus data center via iSCSI

Branch
offices

EML P6500 Main campus

Tape EVA data center
Library

5
 Virtual machine deployment
The iSCSI capability in the P6300/P6500 EVAs and the MPX200 Multi-protocol Router can be very
useful in virtual machine environments. With VMware, for example, customers want to run large
numbers of applications on a single physical server with a LUN assigned to each VM. At the same
time, customers would like to connect large number of servers to the same shared storage unit. The
resulting number of LUNs can exceed the number of LUNs supported by the storage unit, which is
256 LUNs for an EVA. When that happens, the VMware hypervisor must subdivide the LUNs. That
results in poor storage management and poor security as the LUNs on the storage unit are being
shared. So, if one application would like to do a local backup on the EVA using Business Copy, the
entire LUN is replicated, not just the part of the LUN the one application is using.

Figure 4: Use case—With FC SAN, the LUNs are limited to 256

Hypervisor OS limits
SAN LUNs to 256 max VM VM
VM VM
VM VM VM VM
VM VM
VM VM
HBA Initiator
HBA Initiator
Hypervisor
HBA Initiator
Hypervisor
Hypervisor

VM VM
VM VM
VM VM
VM VM
VM VM
VM VM

HBA Initiator
SAN HBA Initiator
HBA Initiator
Hypervisor
Hypervisor
Hypervisor

6
However, using the 10 Gb iSCSI capability in P6300/P6500 EVAs (or the MPX200), up to
1024 VMs (LUNs) can be mapped, significantly improving the number of LUNs supported [Up to
256 VMs (LUNs) with 1 Gb iSCSI]. This improves the storage management and security for the virtual
machine environment.

Figure 5: Use case—With 10 Gb iSCSI, the LUNs (or VMs) can go up to 1024

App App

1024 VMs, LUNs mapped by

App App
OS OS
App App
P6300/P6500 10 Gb iSCSI App
OS
OS
App
OS
OS
App App
OS OS
App App
OS OS
OS OS
Hypervisor
Hypervisor
Hypervisor

App App

App App
OS OS
App App
OS OS
OS OS

NIC NIC
LAN NIC NIC
NIC NIC
Hypervisor
Hypervisor
Hypervisor

Physical Guest OS/ iSCSI

Machine Application Initiator

Mixing 1 Gb and 10 Gb iSCSI

Ethernet switches are available to support a variety of speeds from 10/100 Mbps to 1000 Mbps
(1GbE) to 10GbE. If a customer already has an Ethernet network and the network does not have
10GbE, but it does have 1GbE, then the connection to the P6000 (or MPX200) can be through
1GbE. If the network does have 10GbE ports, the connection to the P6000 (or MPX200) can be
through 10GbE. If neither 1GbE nor 10GbE is in the existing network, it will be necessary to
purchase some new switches to allow the slower 10/100 Mbps network to connect to the 1GbE or
10GbE connections of the P6000 or MPX200.

High availability
The use of less expensive iSCSI, instead of or in addition to FC, still allows for high availability
network configurations. Like redundant FC SANs, iSCSI SANs can employ high availability features.
Each server can be configured with redundant Ethernet HBAs or NICs. Redundant Ethernet paths from
each server can connect to redundant iSCSI ports/controllers on the P6300/P6500 EVAs, or to
redundant MPX200s to redundant FC switches to redundant EVA controllers. Failover software, such
as native MPIO failover software, can be employed to manage the failover of any failed path to an
alternate path. The replication software, like Business Copy EVA and Continuous Access EVA, is also
available for use with the EVA through FC and/or iSCSI.
The drawing below shows redundant FC and iSCSI connections from servers to a P6300/P6500 EVA
for a high availability configuration. Depending on the Ethernet switches used and the P6000 EVA

7
 controllers used, the connections from the switches to the P6000 can be 1GbE or 10GbE. Note that
data traffic from the isolated servers is over iSCSI to the P6000, while the data traffic from the data
center servers is over FC. And the communication between all the servers is over Ethernet. (Not shown
are the 1 Gb Ethernet connections from a CV Management Server to the P6000 which are needed for
management of the iSCSI ports of the controllers.)

Figure 6: iSCSI, Ethernet, and FC SANs in redundant configurations to the P6000

ML370 G6 ML150 G6 c7000 w BL685c

c3000 w BL860c i2
Isolated DL585 G7 Data center
servers servers
with Ethernet
and FC Adapters

Ethernet
E2900-48G
8/40 FC SAN Switches
Ethernet Switches
FC
iSCSI

Data migration
The MPX200 also offers data migration capability. With this option customers can perform high-speed
data migration using FC and/or 1 Gb/s or 10 Gb/s iSCSI between EVAs and also other vendor
arrays. Initially, the data migration must be performed offline, but by mid of 2010 online data
migration will be enabled. The migration operation is managed by a very user friendly interface. The
data migration operation can be very useful to customers as they add new arrays or re-apply older
arrays and they need to move data from one array to another.

Reasons to use FCoE

FCoE is a technology that maps Fiber Channel frames over Ethernet. This allows Fibre Channel to
leverage 10 Gb/s Ethernet networks while preserving the FC protocol. FCoE is based on the
observation that FC is the dominant storage protocol in the data center and that any viable I/O
consolidation solution for storage should be based on the FC model.
The following are some reasons to use FCoE:

Reduce network complexity in the data center

With a converged network using FCoE, separate Ethernet and FC networks can be combined. This
reduces management problems, network adapters, cables, and power and cooling costs.

8
Reduce the number of network interface cards required to connect to
disparate storage and IP networks
Computers connect to FCoE with Converged Network Adapters (CNAs), which contain both
Fibre Channel Host Bus Adapter (HBA) and Ethernet Network Interface Card (NIC) functionality on the
same adapter card. Therefore, separate FC and Ethernet cards are not required.

Reduce the number of cables and switches

Sharing FCoE and Ethernet across the same cables and switches reduces the number of cables and
switches.

Reduce power and cooling costs

Combining interface cards and switches reduces the power and cooling that each separate cards and
switches would have required.

Mixing FC, FCoE, and iSCSI/Ethernet

New Converged Network switches support both FC and FCoE. Plus, the P6000 and MPX200 both
support FCoE and FC. So, the customers can continue to support their existing FC SAN networks and
can begin to add FCoE as they get new servers and new networking equipment.
Figure 7 shows a combination of Ethernet, FCoE, and FC connections. Depending on the Ethernet
switches used and the P6000 EVA controllers used, the connections from the switches to the P6000
can be 1GbE or 10GbE. Note that data traffic from the Isolated Servers is over iSCSI/Ethernet to the
P6000, while the data traffic from the data center servers is over FCoE/FC. (In this example, the
iSCSI ports on the P6000 are used for iSCSI traffic and cannot be used for FCoE.) In addition,
communication between all the servers is over FCoE/Ethernet. (Not shown are Ethernet connections
from a CV Management Server to the P6000 which are needed for management of the iSCSI ports of
the controllers.)

Figure 7: Ethernet, FC, and FCoE in redundant configurations to the P6000

ML370 G6 ML150 G6 c7000 w BL685c

c3000 w BL860c i2
DL585 G7 Data center
Isolated
servers
servers with Converged
Network Adapters

Ethernet FCoE
E2900-48G 2408 FCoE Converged
Ethernet Switches Network Switches

iSCSI

FC

9
 FCoE
The FCoE option available with the P6000 EVA controllers now allows a converged network with
FCoE between servers and the P6000 EVA storage. The result is a more efficient network with high
redundancy and high performance. (Not shown are Ethernet connections from a CV Management
Server to the P6000 which are needed for management of the iSCSI ports of the controllers.)

Figure 8: FCoE in redundant configurations to the P6000

ML370 G6 ML150 G6 c7000 w BL685c

Isolated c3000 w BL860c i2

DL585 G7 Data center
servers
with Converged servers
Network Adapters with Converged
Network Adapters

FCoE
2408 FCoE Converged
Network Switches

FCoE

Consistent Command View management

The powerful and easy-to-use P6000 Command View management software will manage FC,
iSCSI, and FCoE configurations simultaneously. So, customers do not have to learn to use different
management software when using FC, iSCSI, or FCoE with an EVA. With P6000 Command
View—server based management (SBM), using a management server, up to 16 EVAs can be
managed simultaneously. Or, with P6000 Command View—Array Based Management (ABM)
available on the EVA4400, P6300 EVA, and P6500 EVA, Command View running on the
Management Modules of the controller pair can manage the EVA without the need for a separate
management server.

10
The following Command View screen shots show some examples of how Fibre Channel and iSCSI
hosts are presented and the similarity between the two types.

Figure 9: Command View screen shot showing connectivity with FC and iSCSI hosts

In figure 9, the Command View screen shows a Host Status Summary, showing connectivity with FC
and iSCSI hosts. (FCoE hosts would look very similar.)

Figure 10: Command View screen shot showing Virtual Disks created with FC and iSCSI hosts

In figure 10, the Command View screen shows Virtual Disks (Vdisks) created with the FC and iSCSI
hosts. Command View handles the Vdisks seamlessly regardless of the host or interface.
For more information on the P6000 Command View software, visit:
http://h18006.www1.hp.com/storage/software/p6000/cvs/index.html.

11
 HP interconnect equipment
FC
Switches
HP Storage Networking SAN Solutions deliver scalability, performance, and broad interoperability
required for critical data and applications. The switches include: H-series, B-series, and C-series
switches. The switches are designed to meet needs from small and midsized businesses to the largest
corporate enterprises.
For more information on the HP SAN switches visit:
http://h18006.www1.hp.com/storage/networking/index.html

HBAs
HP has FC HBAs for: ProLiant servers, Mezzanine HBAs for ProLiant Blade Servers, and HBAs for HP
Integrity Servers.
For more information on the HP FC HBAs, visit:
http://h18006.www1.hp.com/storage/saninfrastructure/hba.html

Ethernet
Switches
HP has a broad range of networking equipment, including a broad line of switches, routers, network
management, and other networking products. The Ethernet switches include: A-series, E-series and
V-series. The switches support various speeds: 10/100 Mbps, 1GbE, and up to 10GbE.
For more information on the available Ethernet switches, visit:
http://h17007.www1.hp.com/us/en/products/switches/index.aspx

Ethernet adapters
Many servers have built-in Ethernet NIC chips. Others have slots to accept a variety of network
adapter cards, both 1 Gbps and 10 Gbps.
For more information on the available HP Ethernet Adapters, visit:
http://h18004.www1.hp.com/products/servers/networking/index-nic.html

FCoE
Switches
Some of the HP FCoE switches are the same as the FC switches referenced above. The B-series DC
SAN Director Switches have FCoE blades available. Similarly, the B-series SAN switches have a
Converged Network Switch model, the HP 2408 FCoE Switch, with eight 8 Gb/s FC ports and
twenty-four 10 Gb/s FCoE ports. And, the C-series Fabric Switches have Converged Network
Switches models, the HP Nexus 5000 Converged Network Switches.
For more information on the available FCoE (Converged Network) switches, visit:
http://h18006.www1.hp.com/storage/networking/b_switches/index.html
http://h18006.www1.hp.com/storage/saninfrastructure/switches/5000nexus/index.html

12
CNAs
HP Converged Network Adapters (CNAs) are dual-port adapters that provide both Ethernet and Fibre
Channel (FC) connectivity over 10GbE using both Fibre Channel over Ethernet (FCoE) and Converged
Enhanced Ethernet (CEE) standards. By consolidating Ethernet and FC onto a converged adapter, HP
CNAs reduce the number of separate adapters and cables required for your datacenter and also
reduce operational, power and cooling costs while preserving existing Ethernet and Fibre Channel
infrastructure. HP CNAs have also been thoroughly tested with HP ProLiant servers and HP Top of
Rack (ToR) switches to ensure an optimal HP FCoE solution for your data center.
For more information on the available HP CNAs,
visit:http://h10010.www1.hp.com/wwpc/us/en/sm/WF05a/12169-304608-4109633-4109633-
4109633-4118472.html?jumpid=reg_R1002_USEN

Summary
The new P6300/P6500 EVAs offer a new option for 1 Gb/s iSCSI, 10 Gb/s iSCSI, and 10 Gb/s
FCoE support. The MPX200 Multifunction Router is another option for those interfaces as it provides
FCIP and Data Migration options.
To conclude:
 Fibre Channel is the preferred option for mission critical Tier 1 or Tier 2 applications.
 iSCSI is a great general purpose option, is adequate for most workloads, and offers the benefit of
having no distance limitations.
 FCoE is emerging and will replace both traditional Fibre Channel and Ethernet networks over time.
It should be considered today for I/O convergence in new deployments.

13
 For more information
 HP P6000 Command View, visit:
http://h18006.www1.hp.com/storage/software/p6000/cvs/index.html
 HP MPX200 Multifunction Router, visit: www.hp.com/go/mpx200
 HP MPX200 Multifunction Router User Guide, visit:
http://bizsupport1.austin.hp.com/bc/docs/support/SupportManual/c02006413/c02006413.pdf
 Converged Infrastructure, visit: http://www8.hp.com/us/en/solutions/solutions-
detail.html?compURI=tcm:245-785656&pageTitle=converged-infrastructure

To know more about HP P6300/P6500 Enterprise Virtual Array Systems, visit:

www.hp.com/go/P6000

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to
change without notice. The only warranties for HP products and services are set forth in the express warranty
statements accompanying such products and services. Nothing herein should be construed as constituting an
additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.

4AA3-2591ENW, Created June 2011