You are on page 1of 20

HNAS12.

3 Global-Active Device (GAD)


Integration

HNAS12.3 GAD implementation guide

By Software integration Lab


Hitachi Data System

April, 2015
Version 2

HDS Confidential and Internal Use Only Page 1


Contents

Executive Summary .............................................................................................................................. 3

Introduction ........................................................................................................................................... 4

Test Environment .................................................................................................................................. 6

Lab Configuration.................................................................................................................................. 7

Prerequisites ......................................................................................................................................... 8

Implementation ..................................................................................................................................... 9

Allocate volumes and GAD pairs via HCS ............................................................................................ 9

HNAS Node allocation ................................................................................................................. 9

Primary site configuration........................................................................................................... 10

Secondary site configuration ...................................................................................................... 11

Host group configuration for primary and secondary ................................................................. 13

Pair management Server Setup for primary storage and secondary storage............................. 14

Storage Failover in active-active mode ............................................................................................... 15

Primary storage failed and secondary storage in active mode ................................................... 17

Conclusion .......................................................................................................................................... 19

HDS Confidential and Internal Use Only Page 2


Executive Summary

The objective of this paper is to provide implementation of HNAS 12.3 new features and VSP G1000 Global-Active
Device (GAD) integration using Hitachi HiCommand Suite software (HCS). It describes the benefits of how HNAS
preferred path feature is utilized in the GAD configuration when path failover occurs.

Preferred path is a new feature in HNAS 12.3 where HNAS will set the preferred path automatically to access the VSP
G1000 primary volume. HNAS server will detect whether the system drives presented by a VSP G1000 array are GAS
and are the primary or secondary volumes.

HDS Confidential and Internal Use Only Page 3


Introduction

The VSP G1000 provides the Global-Active Device feature (GAD) that manages the primary/secondary relationship in a
mirror configuration internally, exposing a virtual GAD volume to the host (HNAS). To HNAS, the GAD volume is shown
as normal simplex System Drive. The failover of the mirror relationship is managed internally by the VSP G1000 software
feature and is thus transparent to HNAS.

HNAS 12.3 GAD integration provides the following capabilities

1. Active-Active storage system clustering - simplifying failover operations and eliminating the downtime in case of
storage system failure

2. HNAS preferred path support – HNAS automatically set the primary volumes as preferred path

HDS Confidential and Internal Use Only Page 4


Intended Audience

This document is intended for Storage administrators seeking to utilize the new HNAS v12.3 features in GAD
configuration. The administrator requires the following knowledge

 Basic knowledge of Storage Area Networks

 Basic operational knowledge of Hitachi Command suite

 Basic knowledge of Hitachi NAS Platform

HDS Confidential and Internal Use Only Page 5


Test Environment

Management Software

Hitachi Command suite 8.1.3-00

Hitachi Virtual Storage

VSP G1000 (Primary) Microcode SVP : 80-02-40/03


Microcode DKC : 80-02-40-00/04

HDP – NLSAS PG(5-2) Raid 6(6D+2P)

VSP G1000 (Secondary) Microcode SVP : 80-02-40/03


Microcode DKC : 80-02-40-00/04

HDP – NLSAS PG (5-6) Raid 6(6D+2P)

VSP (Quorum) Microcode DKC: 70-06-21-00/00


Microcode SVP : 70-06-14/00

Hitachi NAS

SMU 300 12.3.3826.02

HNAS 4100 cluster 12.3.3826.03a

Fiber Channel Switches

Brocade switch Model 6510

Storage Port configuration for GAD

HNAS Node Storage HNAS FC Port VSP G1000 Host Port

Node 1 Primary storage Port 1 CL3-B

Node 2 Primary storage Port 1 CL3-B

Node 1 Secondary storage Port 3 CL5-A

Node 2 Secondary storage Port 3 CL5-A

HDS Confidential and Internal Use Only Page 6


Lab Configuration

Public LAN

SMU 300

Domain Controller
PowerEdge
1950

Hitachi Command Suite


http://172.17.XX.XXX:22015/DeviceManagerWebService/index.jsp

HNAS 4100 Cluster

Windows Server 2012 Standard

HNAS communication through


Fibre Channel

Brocade Configuration

GAD Configuration

Quorum

VSP (R700)

Figure 1 - Configuration diagram

HDS Confidential and Internal Use Only Page 7


Prerequisites

 Hitachi Command Suite (HCS) v8.0.1 or higher. Note: HCS 8.1.3.00 is used in this test

 HDP Pool must be created with at least 4 volumes on the primary as well as secondary storage. The storage
array configuration chosen for use in this exercise is for reference only and should not be used as a basis to
properly size HNAS for performance.

Note: HNAS requires at least 4 volumes in the HDP Pool for minimal configurations..

 GAD environment should have the following set ups

■ Configure Remote paths


■ Configure Quorum Disks
■ Configure Pair Management Servers
■ Configure Virtual Storage Machine

 HNAS 12.3 or higher is required for preferred path support

HDS Confidential and Internal Use Only Page 8


Implementation

Global-active device allows the user to create and maintain synchronous, remote copies of data volumes on the VSP
G1000. Once a GAD pair has been created, the PVOL and SVOL can accept I/O from the host. The GAD pair volumes
are seen by HNAS as a single volume on a single storage system. HNAS is not writing IO to both the primary and
secondary, instead the array is synchronously moving data from the primary to the secondary and HNAS is not writing IO
to the S-Vol.
The following shows the GAD set up and how HNAS set preferred path when the storage failover occurs

Allocate volumes and GAD pairs via HCS


 HNAS nodes allocation
 Primary site configuration
 Secondary site configuration
 Host group configuration for primary and secondary

 Pair management Server Setup for primary storage and secondary storage

HNAS Node allocation

 Add HNAS nodes to HCS as a Host where OS type is “Others”. Note: HNAS added as “fileservers” is currently
not supported

Figure 2 – Add HNAS as “Other”

 During the HNAS host allocation process, make sure to select the allocation type as Global-Active device

HDS Confidential and Internal Use Only Page 9


Figure 3 – HNAS nodes for allocating volume Figure 4 – Volume type setting for GAD

Primary site configuration

 Select the primary storage IP Address, virtual storage machine, and volume type. In this test scenario, dynamic
provisioning (HDP) is used as volume type
In the Advanced option, specify the volume criteria and select the designated DP pool for the primary site
Note: The raid level must be the same for both primary and secondary

Figure 5 – P-vols allocation

HDS Confidential and Internal Use Only Page 10


 Setup LUN paths for primary storage:

Figure 6 - Configuring LUN paths for primary site

 Expand the LUN path options-> Edit LUN paths

 Select storage port (CL3-B) and assign to Host Port WWN/Port 1 of HNAS node 1 and HNAS Node 2, see Test
Environment for port details. Note: These ports must be zoned on the switch correctly.

Zone Name HNAS FC Ports VSP G1000 Host Ports

GAD61_4770_CL3B HNAS Node 1 Port 1 Primary site Port ID CL3-B

GAD21_4770_CL3B HNAS Node 2 Port 1 Primary site Port ID CL3-B


Table 1 – HNAS and VSP G1000 zoning for primary

Secondary site configuration

 Select IP address of the secondary storage, Virtual storage machine, Volume type and Volume location just like
the primary storage

 Select the HD pool created for secondary site

HDS Confidential and Internal Use Only Page 11


Figure 7 – Setting up S-Vols

 Expand the LUN path options-> Edit LUN paths

 Select storage port (CL5-A) and assign to Host Port WWN/Port 3 of HNAS node 1 and HNAS Node 2, see Test
Environment for port details. Note: These ports must be zoned on the switch correctly.

Zone Name HNAS FC Ports VSP G1000 Host Ports


GAD63_4771_CL5A HNAS Node 1 Port 3 Secondary site Port ID CL5-A

GAD23_4771_CL5A HNAS Node 2 Port 3 Secondary site Port ID CL5-A

Table 2 – HNAS and VSP G1000 zoning for secondary

HDS Confidential and Internal Use Only Page 12


Figure 8- LUN path for secondary

Host group configuration for primary and secondary


In this test scenario, a single local HNAS cluster is used for both primary and secondary therefore, only one host group is
configured on each storage target port. If there is a remote HNAS cluster, the second host group would be needed for
secondary
 Select “Shared by All Hosts” and specify a name for host group for the primary storage

 Use “Standard” host mode for the host group

 There is one host group per storage target port.

HDS Confidential and Internal Use Only Page 13


Figure 9 – set up host group for primary

 Use the same steps on figure 9 to set up the host groups for secondary storage

Pair management Server Setup for primary storage and secondary storage

 Select the pair management server and assign an Instance ID and a UDP port number. There are restrictions
what values can be used for Instance number and UDP ports, see Pair management user guide for details

Figure 20 – Pair management settings for primary site

 Use the steps in figure 10 to configure pair management server for secondary storage.

HDS Confidential and Internal Use Only Page 14


 The Task for this configuration will run for several minutes. Task details can be viewed in the task status once
complete. .

Figure 11 – Task details for GAD pairs

Storage Failover in active-active mode

Active–Active storage clustering allows concurrent access of applications running on the HNAS file systems. It also
simplifies failover operations, eliminating the downtime in case of storage failure. Once the GAD pairs are successfully
created, the GAD volumes will be shown in HNAS as below

-----------------------------------------------------------------------------------------

scsil-cl3-1:$ sd-list 1 5 7 16
Device Status Alw GiByte Mirror In span Span Cap
------ ------ --- ------ ------- ---------------------------- --------
1 OK Yes 32 Pri VJ_GAD_POOL 128
5 OK Yes 32 Pri VJ_GAD_POOL 128
7 OK Yes 32 Pri VJ_GAD_POOL 128
16 OK Yes 32 Pri VJ_GAD_POOL 128
-----------------------------------------------------------------------------------------------------

The “sdpath 1” results below show the system drive presented to HNAS is connected to primary storage.
50060E8007278821 is the port WWN of the primary storage

-----------------------------------------------------------------------------------------------------
scsil-cl3-1:$ sdpath 1
Device 1 Preferred host port: None (Current: 1)
Ports: Raid controller Port name
* 03/A/50302788-1 50060E8007278821
03/A/50302788-1 50060E8007278740

The output of the “scsi-devices –d 1” console command confirms HNAS has detected a GAD volume. It also shows
HNAS has automatically set the preferred path to the primary storage in order to optimize I/O flow to the localized VSP
G1000.

HDS Confidential and Internal Use Only Page 15


scsil-cl3-1:$ scsi-devices -d 1

Logical Unit: SD 1
HITACHI OPEN-V Rev 8001 : Model VSP G1000
LUID : [03:01:00]60:06:0E:80:07:27:88:00:00:30:27:88:00:00:02:6F
LUID (external) : 60:06:0E:80:07:27:88:00:00:30:27:88:00:00:02:6F
Device type disk is connected
Device reported status: good
Capacity : 32.00GB (67108864 blocks, block size 512)
Internal LUN : 26F
Info : SAS drives, is a GAD volume
Average Status : OK
Current Status : OK
Last 4 entries from state change log: (use "scsi-dslog -d 1 -a" to view entire log)
2015-04-07 12:18:14.474 Device failed, all ports are offline
2015-04-07 12:18:44.416 has become good
2015-04-07 12:30:38.681 Hport 1 Port 0 media check OK
2015-04-07 12:30:38.682 opened using Hport 1 Port 0 nexus 0

LUN 3 (Hport 1 SCSI port 0 nexus 0) :


Port Name : 50:06:0E:80:07:27:88:21
Port Addrs : 22B00
Status : online
Last Cmd : STD Inquiry : OK (@ 2015-04-07 12:39:34-07:00)
Prev cmd returning Bus Reset status: (@ 2015-04-07 12:30:38-07:00)
Mode Sense10 returned Check Cond :
unit attn, power on or bus device reset (ASC 29/00)
Device opened using this nexus
Preferred path : yes (controller)

LUN 3 (Hport 3 SCSI port 5 nexus 1) :


Port Name : 50:06:0E:80:07:27:87:40
Port Addrs : 51B00
Status : online
Last Cmd : Mode Sense10 : OK (@ 2015-04-07 12:37:47-07:00)
Prev cmd returning not GOOD status: (@ 2015-04-07 12:29:27-07:00)
VPD Inquiry, page B0h returned Check Cond :
illegal request, invalid field in CDB (ASC 24/00)
(First instance of this status @ 2015-04-07 12:21:14-07:00)
Preferred path : no
================== 2015-04-07 12:39:37-07:00 ==================

HDS Confidential and Internal Use Only Page 16


Primary storage failed and secondary storage in active mode

Figure 12 shows the primary storage site is down and a failover has occurred. HNAS will detect the preferred path failure
and will automatically redirect to the non-preferred path thus, host applications can still run without disruption by using S-
Vol. The “sdpath 1” outputs below shows the system drive presented to HNAS is connected to secondary storage.
50060E8007278740 is the port WWN of the secondary storage

---------------------------------------------------

scsil-cl3-1:$ sdpath 1
Device 1 Preferred host port: None (Current: 3)
Ports: Raid controller Port name
* 03/A/50302788-1 50060E8007278740
-------------------------------------------
The output of the “scsi-devices –d 1” console command confirms HNAS has detected a GAD volume and it automatically
set the path to the secondary storage.

-------------------------------------------------------------
scsil-cl3-1:$ scsi-devices -d 1

Logical Unit: SD 1
HITACHI OPEN-V Rev 8001 : Model VSP G1000
LUID : [03:01:00]60:06:0E:80:07:27:88:00:00:30:27:88:00:00:02:6F
LUID (external) : 60:06:0E:80:07:27:88:00:00:30:27:88:00:00:02:6F
Device type disk is connected
Capacity : 32.00GB (67108864 blocks, block size 512)
Internal LUN : 26F
Info : SAS drives, is a GAD volume
Average Status : OK
Current Status : OK
Last 4 entries from state change log: (use "scsi-dslog -d 1 -a" to view entire log)
2015-04-07 14:02:55.664 Hport 1 Port 0 nexus 0 failed : offline
2015-04-07 14:02:57.685 Hport 3 Port 5 media check OK
2015-04-07 14:02:57.685 Hport 3 Port 5 nexus 1 selected : recover
2015-04-07 14:03:27.683 Path validation for slow path I/O complete

LUN 3 (Hport 1 SCSI port 0 nexus 0) :


Port Name : 50:06:0E:80:07:27:88:21
Port Addrs : 22B00
Status : offline
Prev cmd returning Bus Reset status: (@ 2015-04-07 13:39:44-07:00)
Mode Sense10 returned Check Cond :
unit attn, power on or bus device reset (ASC 29/00)
Preferred path : unknown

LUN 3 (Hport 3 SCSI port 5 nexus 1) :


Port Name : 50:06:0E:80:07:27:87:40
Port Addrs : 51B00
Status : online
Last Cmd : STD Inquiry : OK (@ 2015-04-07 14:18:33-07:00)
Prev cmd returning Bus Reset status: (@ 2015-04-07 14:02:57-07:00)
Mode Sense10 returned Check Cond :
unit attn, power on or bus device reset (ASC 29/00)
Device opened using this nexus
Preferred path : no
================== 2015-04-07 14:18:40-07:00 ==================

HDS Confidential and Internal Use Only Page 17


HNAS Node 1 (Active node) HNAS Node 2 (Standby Node)

AdminEVS HNAS Filesystem AdminEVS HNAS Filesystem


Fileserver HNAS 2-node Cluster Fileserver
EVS EVS
Cluster Interconnect
Cifs/nfs Cifs/nfs
shares shares
Port1 Port3 Port1 Port3
Port WWN=5003017000045D651 Port WWN=5003017000045D63 Port WWN=5003017000045C21 Port WWN=5003017000045C23

Preferred path

Non Preferred Path


Preferred path

Non Preferred Path

Storage PortID = CL3-B Storage Port ID=CL5-A


Storage Port WWN= 50060E8007278821 Storage Port WWN=50060E8007278740

Hostgroup Hostgroup

PVOL PVOL PVOL PVOL SVOL SVOL SVOL SVOL


GAD
HDP POOL HDP POOL

Primary storage system Secondary storage system


VSPG1000 VSPG1000

Quorum

VSP(R700)

Figure 12 – Primary storage down, secondary active

HDS Confidential and Internal Use Only Page 18


Conclusion
HNAS 12.3 provides the GAD preferred path feature that will set the primary/secondary path failover automatically. The
users are not required to use the HNAS sdpath command to force HNAS to set the path to storage subsystem.

HDS Confidential and Internal Use Only Page 19


Corporate Headquarters 750 Central Expressway, Santa Clara, California 95050-2627 USA
Contact Information: + 1 408 970 1000 www.hds.com / info@hds.com

Asia Pacific and Americas 750 Central Expressway, Santa Clara, California 95050-2627 USA
Contact Information: + 1 408 970 1000 www.hds.com / info@hds.com

Europe Headquarters Sefton Park, Stoke Poges, Buckinghamshire SL2 4HD United Kingdom
Contact Information: + 44 (0) 1753 618000 www.hds.com / info.uk@hds.com
Hitachi is a registered trademark of Hitachi, Ltd., and/or its affiliates in the United States and other countries. Hitachi Data Systems is a registered
trademark and service mark of Hitachi, Ltd. In the United States and other countries.
Hitachi Data Systems has achieved Microsoft Competency in Advanced Infrastructure Solutions.
All other trademarks, service marks, and company names are properties of their respective owners.
Notice: This document is for informational purposes only, and does not set forth any warranty, express or limited, concerning any equipment or service
offered or to be offered by Hitachi Data Systems. This document describes some capabilities that are conditioned on a maintenance contract with Hitachi
Data Systems being in effect, and that may be configuration-dependent, and features that may not be currently available. Contact your local Hitachi Data
Systems sales office for information on feature and product availability.
Hitachi Data Systems sells and licenses its products subject to certain terms and conditions, including limited warranties. To see a copy of these terms
and conditions prior to purchase or license, please go to http://www.hds.com/corporate/legal/index.html or call your local sales representatives to obtain
a printed copy. If you purchase or license the product, you are deemed to have accepted the terms and conditions.
© Hitachi Data Systems Corporation 2008. All Rights Reserved

You might also like