Professional Documents
Culture Documents
com
VCE Systems
Powering On and Off Guide
Revision history
Date Document Description of changes
revision
April 2016 1.21 Changed document title to VCE™ Systems Powering On and Off Guide.
Updated power on and powering off instructions to support the VxBlock™
System 240.
January 2016 1.19 Removed references to products that have reached end of sale:
• Vblock 0
• Vblock 1
• Vblock 1U
October 2015 1.18 Updated the power on and power off instructions to add Cisco Nexus 1000V
Virtual Supervisor Module Virtual Machine and Cisco Virtual Switch Update
Manager Virtual Machine.
Updated information about Power Distribution Units (PDUs) to reflect the
Intelligent Physical Infrastructure (IPI) components.
August 2015 1.17 Updated to include VxBlock Systems, VCE™ Technology Extension for Cisco
UCS compute, VCE™ Technology Extension for EMC storage, VMware
vSphere 6.0, and VMware NSX.
February 2015 1.16 Added new sections for VCE™ Technology Extension for EMC Isilon storage
and VCE Integrated Data Protection.
Updated with information about Vblock System 540 and Vblock System 740.
December 2014 1.15 Updated with information about AMP-2HA Performance (EMC VNXe3200
storage) for the Vblock System 340.
February 2014 1.13 Updated with information for Vblock Specialized System for Extreme
Applications.
2
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Revision history
November 2013 1.12 Updated with information related to VMware vSphere Standard Edition (version
5.1 and later).
October 2013 1.11 Removed information about powering on and powering off VCE Integrated Data
Protection. Added a pointer to the VCE Integrated Data Protection Guide.
September 1.10 Updated links to EMC documentation for EMC CLARiiON CX4-480, EMC
2013 Symmetrix VMAX 40K Series, EMC Symmetrix VMAX 20K Series, and EMC
Symmetrix VMAX 10K Series.
August 2013 1.9 Added missing information about powering off Cisco Nexus switches.
October 2012 1.6 • Updated EMC links from EMC PowerLink to EMC Support.
• First Customer Ship for Vblock System 700.
February 2012 1.3 First Customer Ship for Vblock System 700 model LX.
December 2011 1.2 First Customer Ship for Vblock System 100.
September 1.1 Added links to EMC storage procedures for all Vblock Systems.
2011
3
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Contents
Contents
Introduction................................................................................................................................................. 5
Vblock System 200 and VCE Vblock and VxBlock Systems 240 series.............................................. 10
Powering on a Vblock System 200 or VCE Vblock and VxBlock Systems 240 series.........................10
Powering off a Vblock System 200 or VCE Vblock and VxBlock Systems 240 series.........................13
References.................................................................................................................................................44
4
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Introduction VCE Systems Powering On and Off Guide
Introduction
This document provides procedures for powering on and powering off a Vblock System,VxBlock System,
and a VxRack System with FLEX.
In this document, the Vblock System, VxBlock System, and VxRack System with FLEX are referred to as
VCE Systems.
This manual assumes that the person who is powering on or powering off the VCE System has the
following:
The VCE Glossary provides terms, definitions, and acronyms that are related to VCE Systems.
5
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Vblock System 100
Before powering on the Vblock System, ensure that you have properly installed and cabled all Vblock
System components. Refer to the Cisco documentation at www.cisco.com for information about the LED
indicators.
Customer-provided services such as Active Directory, DNS, NTP, and so on, as well as physical
infrastructure such as reliable power, adequate cooling, and core network access must be available prior
to proceeding with any Vblock System power on activity.
This procedure describes how to power on the Vblock System components in a specific order.
For each component that you power on, if you smell smoke or see fire, immediately power
off the component and call VCE ® Support for assistance.
Procedure
1 Ensure that the POU breakers are in the OPEN (or OFF) position. If the breakers are not in the
OPEN position, use a small tool to press the small white tab below each switch for the circuit to
open. These switches are located below the ON/OFF breaker.
3 Ensure that power is available to the POUs and that the LEDs on the POUs display a number.
4 Close the POU circuit breaker on POU A by pressing the side of the switch that is labeled ON.
This causes the switch to lie flat. Ensure that all of the components that are connected to the
POU A power supply light up as expected.
5 Close the POU circuit breaker on POU B by pressing the side of the switch that is labeled ON.
This causes the switch to lie flat. Ensure that all of the components that are connected to the
POU B power supply light up as expected.
6 Power on the management switches. Wait until the PS1 and PS2 LEDs are solid green before
proceeding.
6
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Vblock System 100 VCE Systems Powering On and Off Guide
c Refer to the How to power cycle the VNXe system safely document.
8 Power on the Cisco UCS C2X0 servers that contain the virtual machines. Wait until the power
status LED is solid green before proceeding.
9 Power on the following components by logging into the appropriate host via the VMware vSphere
C# Client:
Note: Ensure that the database servers are configured to start at least 2 minutes before the
VMware vCenter servers and the VMware vSphere Update Manager servers.
b Microsoft SQL Server Database Virtual Machine (vCenter/VUM) (wait two minutes before
proceeding)
a Log in to the production VMware vCenter Server, and confirm that all VMware ESXi hosts
have started.
b Power on any virtual machines that are not set to start automatically with the system.
11 If the Vblock System contains VCE Integrated Data Protection, refer to VCE Integrated Data
Protection information.
Related information
7
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Vblock System 100
To facilitate powering on the Vblock System at a later time, document the location of the management
infrastructure virtual machines on their respective hosts. Also verify that all startup configurations for the
Cisco devices are saved.
Procedure
1 From VMware vCenter Server, power off the production Vblock System (not the management
infrastructure) virtualized infrastructure in the following order:
Note: In this step, do not power off the VMware ESXi hosts (Host A and Host B) that contain
the management infrastructure.
2 Connect the VMware vSphere C# Client to the VMware ESXi host directly, not through the
VMware vCenter Server or Element Manager.
3 To facilitate powering on the Vblock System at a later time, record the ESXi host location for the
following virtual machines:
8
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Vblock System 100 VCE Systems Powering On and Off Guide
5 From the VMware vSphere C# Client, shut down the ESXi hosts (Host A and Host B) that contain
the management infrastructure.
Note: If the Vblock System contains VCE Integrated Data Protection, refer to VCE Integrated
Data Protection for information.
6 Refer to the EMC VNXe documentation to power off the storage components.
c Refer to the How to power cycle the VNXe system safely document.
9 On POU A, turn off the POU power breakers off (OPEN position).
Related information
9
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Vblock System 200 and VCE Vblock and VxBlock Systems 240 series
Before powering on the VCE System, ensure that you have properly installed and cabled all VCE System
components. Refer to the Cisco documentation at www.cisco.com for information about the LED
indicators.
Customer-provided services such as Active Directory, DNS, NTP, and so on, as well as physical
infrastructure such as reliable power, adequate cooling, and core network access must be available prior
to proceeding with any VCE System power on activity.
This procedure describes how to power on the VCE System components in a specific order.
For each component that you power on, if you smell smoke or see fire, immediately power
off the component and call VCE® Support for assistance.
Procedure
1 Ensure that the POU breakers are in the OPEN (or OFF) position.
If the breakers are not in the OPEN position, use the small enclosed tool to press the small white
tab below each switch for the circuit to open. These switches are located below the ON/OFF
breaker.
3 Ensure that power is available to the POUs and that the LEDs on the POUs display a number.
4 Close the POU circuit breakers on all POUs for Zone A. To do this step:
a Press the side of the switch that is labeled ON. This causes the switch to lie flat.
b Ensure that all of the components that are connected to the POUs on Zone A light up.
5 Close the POU circuit breakers on all POUs for Zone B. To do this step:
a Press the side of the switch that is labeled ON. This causes the switch to lie flat.
10
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Vblock System 200 and VCE Vblock and VxBlock Systems 240 series VCE Systems Powering On and Off Guide
b Ensure that all of the components that are connected to the POUs on Zone B light up.
6 Power on the network components in the following order. The network components take about 10
minutes to power on.
a Management switch—Wait until the PS1 and PS2 LEDs are solid green before proceeding.
b Cisco Nexus aggregation switches—Wait until the system status LED is green before
proceeding.
7 Power on the storage components. Refer to the VNX5X00 powerup section in the EMC VNX
Series Systems Operations Guide.
8 If the VCE System has an attached VCE™ Technology Extension for EMC Isilon storage system,
power it on now.
9 Power on the VCE System (AMP) Cisco UCS C2X0 hosts. The physical AMP will have one
server, while the virtual AMP will have two servers. Wait about 10 minutes for the power status
LED to turn solid green before proceeding.
10 Note: Skip this step if the AMP virtual machines are set to start automatically within the system
(AMP-2P only)
Notes:
— To complete this step, connect the VMware vSphere Client directly to the AMP host, because
the AMP VMware vCenter Server is not yet available. Ensure DNS and NTP services are
available and properly configured.
— Ensure that the database servers are configured to start at least two minutes before the
VMware vCenter servers and the VMware vSphere Update Manager servers.
— VMware VCenter Server Appliance (VCSA) is the default management option for the AMP-2
with M4 servers. Either the VMware vCenter Server Appliance or the VMware vCenter Server
Virtual Machine must be deployed.
b Microsoft SQL Server Database Virtual Machine (vCenter/VUM) (wait two minutes before
proceeding)
11
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Vblock System 200 and VCE Vblock and VxBlock Systems 240 series
h Cisco Nexus 1000V Virtual Supervisor Module Virtual Machine (if applicable)
11 To power on the VCE System production hosts, power on all Cisco UCS C2X0 servers from
CIMC.
a Log in to the production VMware vCenter and confirm that all VMware ESXi hosts are started.
b Power on any virtual machines that do not start automatically with the system.
13 If the VCE System contains VCE Integrated Data Protection, refer to VCE Integrated Data
Protection for information.
Related information
Powering on a VCE Technology Extension for EMC Isilon Storage System (see page 36)
12
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Vblock System 200 and VCE Vblock and VxBlock Systems 240 series VCE Systems Powering On and Off Guide
To facilitate powering on the VCE System at a later time, document the location of the management
infrastructure virtual machines on their respective hosts. Also verify that all startup configurations for the
Cisco devices are saved.
Procedure
1 Shut down the VCE System production hosts in the following order:
d Cisco UCS C2X0 servers by using CIMC or by pressing the power button.
e If the VCE System contains VCE Integrated Data Protection, refer to VCE Integrated Data
Protection for information.
■ If this is a unified configuration, power off only the DME and control stations and skip the
next step.
2 Power off all the Cisco C-Series compute servers via the CIMC
3 Connect the VMware vSphere C# Client to the Physical or Logical AMP host directly, not through
the VMware vCenter Server or Element Manager.
13
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Vblock System 200 and VCE Vblock and VxBlock Systems 240 series
4 To facilitate powering on the VCE System at a later time, record the ESXi host location for the
following virtual machines:
— Microsoft SQL Server Database Virtual Machine (vCenter/VUM) (optional, only configured if
VCSA has not been deployed)
Note: Ensure that there is a delay (minimum of 180 seconds) between each of the machines
during the power off sequence.
a Connect to a laptop or to another machine with network IP access to the VCE System.
Ensure that the following applications are installed:
■ Putty
b Connect the VMware vSphere C# Client directly to the AMP VMware ESXi hosts where the
AMP virtual machines reside using the root account. Do not connect through the AMP
VMware vCenter Server or Jump Server.
14
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Vblock System 200 and VCE Vblock and VxBlock Systems 240 series VCE Systems Powering On and Off Guide
c Shut down the AMP management virtual machines in the following order:
ii Cisco Nexus 1000V Virtual Supervisor Module Virtual Machine (if applicable)
6 Power off the storage components. Refer to “VNX5X00 planned powerdown" in the EMC VNX
Series Systems Operations Guide.
7 If the VCE System has an attached VCE™ Technology Extension for EMC Isilon storage system,
power it off now.
Note: To avoid losing any unsaved configuration changes, type copy running-config
startup-config before powering off the switches.
Note: To ensure that there is no power beyond the POUs, disconnect the AC feeds to all POUs.
The physical planning guide for the VCE System contains additional information about
power specifications.
Related information
Powering off a VCE Technology Extension for EMC Isilon Storage System (see page 37)
15
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Systems and Vblock Specialized System for SAP HANA
Before powering on the VCE System, ensure that you have properly installed and cabled all VCE System
components. Refer to the Cisco documentation at www.cisco.com for information about the LED
indicators.
Customer-provided services such as Active Directory, DNS, NTP, and so on, as well as physical
infrastructure such as reliable power, adequate cooling, and core network access must be available prior
to proceeding with any VCE System power on activity.
This procedure describes how to power on the VCE System components in a specific order.
For each component that you power on, if you smell smoke or see fire, immediately power
off the component and call VCE ® Support for assistance.
16
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems and Vblock Specialized System for SAP HANA VCE Systems Powering On and Off Guide
Procedure
1 Ensure that the Power Distribution Unit (PDU) breakers are in the OPEN (or OFF) positions.
If the breakers are not in the OPEN positions, use the small screwdriver or other flat-edged object
to switch off the circuit breakers. These switches are located below the ON/OFF breakers.
3 Ensure that power is available to the PDUs and that the LEDs on each PDU display a number.
4 Close the PDU circuit breakers on all PDUs for Zone A by pressing the side of the switch that is
labeled ON. This causes the switch to lie flat.
Ensure that all of the components that are connected to the PDUs on Zone A light up.
5 Close the PDU circuit breakers on all PDUs for Zone B by pressing the side of the switch that is
labeled ON. This causes the switch to lie flat.
Ensure that all of the components that are connected to the PDUs on Zone B light up.
6 Power on the network components in the following order. The network components take about 10
minutes to power on.
a Management router—Wait until the main power indicator LED changes from blinking green to
solid green before proceeding.
b Management switches—Wait until the PS1 and PS2 LEDs are solid green before proceeding.
c Cisco Nexus switches—Wait until the system status LED is green before proceeding.
d Cisco SAN switches—Wait until the system status LED is green before proceeding.
7 If the VCE System contains a high availability Advanced Management Platform (HA-AMP), refer
to the EMC VNXe (31xx/33xx) documentation to power on the EMC VNXe.
c Refer to the How to power cycle the VNXe system safely document.
17
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Systems and Vblock Specialized System for SAP HANA
8 If the VCE System contains an AMP-2HA or AMP-2S, refer to the EMC VNXe32xx documentation
to power on the EMC VNXe32xx.
b Following the instructions to download, extract and launch the online help.
e Follow the instructions for powering up the system, listed after The storage system is now
fully powered down.
9 Power on the storage components. Refer to the following table for the procedure to follow for the
VCE System that you are powering on:
VCE Vblock and VxBlock Systems 700 series EMC Symmetrix VMAX 40K Series, EMC
Symmetrix VMAX 20K Series, EMC Symmetrix
VMAX 10K Series, or EMC VMAX3 Family
VCE Vblock and VxBlock Systems 500 series EMC XtremIO storage array
VCE Vblock and VxBlock Systems 300 series EMC VNX System Operations
Vblock Specialized System for SAP HANA EMC VNX System Operations
VCE Technology Extension for EMC VMAX3 storage EMC VMAX3 Family Power Down / Power Up
Procedure
VCE Technology Extension for EMC XtremIO storage EMC XtremIO Storage Array User Guide
VCE Technology Extension for EMC VNX storage Introduction to the EMC VNX2 Series
10 If the VCE System has an attached VCE Technology Extension for EMC Isilon storage system or
a VCE Technology Extension for EMC storage, power it on now.
a Fabric interconnects: Wait until the system status LED is green before proceeding.
b Cisco UCS chassis (top), Cisco UCS chassis (bottom), and so on: For each chassis that you
power on, wait until the chassis health LED is green before proceeding.
c All Cisco UCS blades from the Cisco UCS Manager: For each blade that you power on, wait
until the power LED is green before proceeding.
12 If the VCE System has an attached VCE Technology Extension for Cisco UCS compute, power it
on now.
18
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems and Vblock Specialized System for SAP HANA VCE Systems Powering On and Off Guide
13 Skip this step if the AMP virtual machines are set to start automatically with the system (AMP-2P
only).
Note: To complete this step, connect the VMware vSphere Client directly to the AMP host,
because the AMP VMware vCenter Server is not yet available. Ensure DNS and NTP
services are available and properly configured.
Note: Ensure that the database servers are configured to start at least two minutes before the
VMware vSphere Update Manager servers and VMware vCenter servers.
a Cisco UCS C2x0 server(s) (Wait about 10 minutes for the power status LED to turn solid
green before proceeding.)
d Microsoft SQL Server Database Virtual Machine (vCenter/VUM). Wait 2 minutes before
proceeding.
j Cisco Virtual Switch Update Manager Virtual Machine (VSUM, optional component, vSphere
5.x only)
k Cisco Nexus 1000V Virtual Supervisor Module Virtual Machine(s) (optional component)
l VMware NSX Manager(s) (primary VM first, then secondaries, if any) (optional component)
m VMware NSX Controllers 1-3 (optional components if VMware NSX Manager is deployed)
Note: Ensure that there is a delay (minimum of 180 seconds) between each of the machines
during the power-up sequence.
14 For the NSX Edge Cluster (optional cluster if VMware NSX manager is deployed):
19
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Systems and Vblock Specialized System for SAP HANA
a Log in to the production VMware vCenter Server, and confirm that all VMware ESXi hosts
have started.
b Power on any virtual machines that are not set to start automatically with the system.
16 If the VCE System contains an EMC VNX Gateway, refer to the EMC VNX Systems Operations
Guide to power on the gateway.
17 If the VCE System contains VCE Integrated Data Protection, refer to VCE Integrated Data
Protection for information.
Related information
Powering on a VCE Technology Extension for EMC Isilon Storage System (see page 36)
20
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems and Vblock Specialized System for SAP HANA VCE Systems Powering On and Off Guide
This task describes how to power off the following VCE Systems:
To facilitate powering on the VCE System at a later time, confirm that the management infrastructure
virtual machines are set to start automatically with the system. Also verify that all startup configurations
for the Cisco devices are saved.
Procedure
a Virtual machines
2 Power off all Cisco UCS servers from the Cisco UCS Manager (if not previously powered off
through the VMware vCenter Server in Step 1).
a Shut down the VMware NSX Edge (optional component) virtualized infrastructure as follows:
3 If the VCE System has an attached VCE Technology Extension for Cisco UCS compute, power it
off now.
4 Connect the VMware vSphere Client to the AMP VMware ESXi host directly, not through the AMP
VMware vCenter Server or Element Manager Server.
21
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Systems and Vblock Specialized System for SAP HANA
5 If the VCE System contains VCE Integrated Data Protection, refer to VCE Integrated Data
Protection for information.
6 If the VCE System contains an EMC VNX Gateway, refer to the EMC VNX Systems Operations
Guide to power off the gateway.
Note: To avoid losing any unsaved configuration changes, type copy running-config
startup-config before powering off the switches.
8 Power off the storage components. Refer to the following table for the procedure to follow for the
VCE System that you are powering off. (Authentication may be required to access these
documents.)
a If the VCE System has an attached VCE Technology Extension for EMC storage, power it off
now.
b If the VCE System has an attached VCE Technology Extension for EMC Isilon storage
system, power it off now.
VCE Vblock and VxBlock Systems 700 series EMC Symmetrix VMAX 40K Series, EMC
Symmetrix VMAX 20K Series, EMC Symmetrix
VMAX 10K Series, or EMC VMAX3 Family
VCE Vblock and VxBlock Systems 500 series EMC XtremIO storage array
VCE Vblock and VxBlock Systems 300 series EMC VNX System Operations
Vblock Specialized System for SAP HANA EMC VNX System Operations
VCE Technology Extension for EMC VMAX3 EMC VMAX3 Family Power Down / Power Up
storage Procedure
VCE Technology Extension for EMC XtremIO Isilon Site Preparation and Planning Guide
storage
VCE Technology Extension for EMC VNX storage Introduction to the EMC VNX2 Series - A Detailed
Review
c VMware NSX Manager(s) (secondaries first, then primary) (optional component if VMware
NSX Manager is deployed)
d Cisco Virtual Switch Update Manager Virtual Machine (VSUM, optional component, VMware
vSphere 5.x only)
22
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems and Vblock Specialized System for SAP HANA VCE Systems Powering On and Off Guide
e Cisco Nexus 1000V Virtual Supervisor Module Virtual Machine (optional component)
10 If the VCE System contains a high availability Advanced Management Platform (HA-AMP), refer
to the EMC VNXe (31xx/33xx) documentation to power off the EMC VNXe platform.
c Refer to the How to power cycle the VNXe system safely document.
11 If the VCE System contains an AMP-2HA or AMP-2S, refer to the EMC VNXe32xx documentation
to power down the EMC VNXe32xx.
b Following the instructions to download, extract and launch the online help.
23
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Systems and Vblock Specialized System for SAP HANA
Note: PDU model QZ1D2Q0BA30P1 does not contain any circuit breakers. To ensure that there
is no power beyond the PDUs, disconnect the AC feeds to all PDUs.
The physical planning guide for the VCE System contains additional information about power
specifications.
Related information
Powering off a VCE Technology Extension for EMC Isilon Storage System (see page 37)
24
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Vblock Specialized Systems for Extreme Applications VCE Systems Powering On and Off Guide
Before powering on the VSS XAPP, ensure that you have properly installed and cabled all VSS XAPP
components. Refer to the Cisco documentation at www.cisco.com for information about the LED
indicators.
Customer-provided services such as Active Directory, DNS, NTP, and so on, as well as physical
infrastructure such as reliable power, adequate cooling, and core network access must be available prior
to proceeding with any VSS XAPP power on activity.
This procedure describes how to power on the VSS XAPP components in a specific order.
For each component that you power on, if you smell smoke or see fire, immediately power
off the component and call VCE ® Support for assistance.
Procedure
1 Ensure that the Power Distribution Unit (PDU) breakers are in the OPEN (or OFF) positions.
If the breakers are not in the OPEN positions, use a screwdriver or other flat tool to press the tab
below each switch for the circuit to open. These switches are located below the ON/OFF
breakers.
3 Ensure that power is available to the PDUs and that the LEDs on each PDU display a number.
4 Close the PDU circuit breakers on all PDUs for Zone A by pressing the side of the switch that is
labeled ON. This causes the switch to lie flat.
Ensure that all of the components that are connected to the PDUs on Zone A light up.
5 Close the POU circuit breakers on all PDUs for Zone B by pressing the side of the switch that is
labeled ON. This causes the switch to lie flat.
Ensure that all of the components that are connected to the PDUs on Zone B light up.
25
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Vblock Specialized Systems for Extreme Applications
a Management router—Wait until the main power indicator LED changes from blinking green to
solid green before proceeding.
b Management switches—Wait until the PS1 and PS2 LEDs are solid green before proceeding.
c Cisco Nexus switches—Wait until the system status LED is green before proceeding.
7 For the AMP for VSS XAPP, refer to the EMC VNXe documentation to power on the EMC VNXe.
c Refer to the How to power cycle the VNXe system safely document.
8 Power on the EMC XtremIO storage components. Refer to the EMC XtremIO Storage Array
Operations Guide for detailed instructions.
Note: This procedure requires that you run CLI commands as a user with Administrator
privileges.
a Fabric interconnects— Wait until the system status LED is green before proceeding.
b Cisco UCS chassis (top), Cisco UCS chassis (bottom), etc—For each chassis that you power
on, wait until the chassis health LED is green before proceeding.
c All Cisco UCS blades from the Cisco UCS Manager—For each blade that you power on, wait
until the power LED is green before proceeding.
10 Skip this step if the AMP for VSS XAPP virtual machines are set to start automatically with the
system.
Note: To complete this step, connect the VMware vSphere Client directly to the AMP for VSS
XAPP host, because the AMP for VSS XAPP VMware vCenter Server is not yet available.
Note: Ensure that the database servers are configured to start at least 2 minutes before the
VMware vCenter servers and the VMware vSphere Update Manager servers.
a Cisco UCS C2X0 server(s)—Wait until the power status LED is solid green before
proceeding.
b Microsoft SQL Server Database Virtual Machine (vCenter/VUM)—Wait two minutes before
proceeding.
26
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Vblock Specialized Systems for Extreme Applications VCE Systems Powering On and Off Guide
Note: Ensure that there is a delay (minimum of 180 seconds) between each of the machines
during the power on sequence.
a Log on to the production VMware vCenter instance, and confirm that all VMware ESXi hosts
have started.
b Power on any virtual machines that are not set to start automatically with the system.
13 If the VCE System contains VCE Integrated Data Protection, refer to VCE Integrated Data
Protection for information.
Related information
27
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide Vblock Specialized Systems for Extreme Applications
To facilitate powering on the VSS XAPP at a later time, confirm that the management infrastructure virtual
machines are set to start automatically with the system. Also verify that all startup configurations for the
Cisco devices are saved.
Procedure
2 Power off all Cisco UCS blades from the Cisco UCS Manager (if not previously powered off
through the VMware vCenter Server in Step 1).
3 Connect the VMware vSphere Client to the AMP for VSS XAPP VMware ESXi host directly, not
through the AMP for VSS XAPP VMware vCenter Server or Element Server.
4 If the VSS XAPP contains VCE Integrated Data Protection, refer to VCE Integrated Data
Protection for information.
5 Shut down the storage components. Refer to the EMC XtremIO Storage Array Operations Guide
for detailed instructions.
6 Shut down the AMP for VSS XAPP virtualized infrastructure as follows:
Note: This procedure requires running CLI commands with Administrator privileges.
Note: Ensure that the database servers are configured to start at least 2 minutes before the
VMware vCenter servers and the VMware vSphere Update Manager servers.
28
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
Vblock Specialized Systems for Extreme Applications VCE Systems Powering On and Off Guide
7 Refer to the EMC VNXe documentation to power off the AMP forVSS XAPP.
c Refer to the How to power cycle the VNXe system safely document.
Note: PDU model QZ1D2Q0BA30P1 does not contain any circuit breakers. To ensure that there
is no power beyond the PDUs, disconnect the AC feeds to all PDUs.
The physical planning guide for the VCE System contains additional information about power
specifications.
Related information
29
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Integrated Data Protection
The VCE Integrated Data Protection Guide provides information about available data protection solutions
for VCE Systems.
Verify that no backups or restores are running when you power off the VCE Integrated Data Protection
with EMC Avamar.
Refer to the EMC Avamar Administration Guide for information about powering on and powering off the
system. Refer to the sections about server shutdown and restart for information about using the dpnctl
program to power on or power off the EMC Avamar server or selected subsystem.
Alternatively, follow the instructions provided in this section to generate shutdown instructions using the
EMC SolVe Desktop utility.
Related information
To download the EMC SolVe Desktop, go to support.emc.com and search for SolVe.
Procedure
2 Re-authorize if prompted and download any available updates for EMC Avamar.
30
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Integrated Data Protection VCE Systems Powering On and Off Guide
4 Select the following options to generate the EMC Avamar server shutdown documentation:
Select Reboot or Shutdown — Shutdown Select sub option and click Next.
6 Review the selected options and click Generate to create the required documentation.
EMC SolVe Desktop compiles the selected documentation and creates a Microsoft Word file that
opens when it is complete.
Related information
Important: Before shutting down the EMC Avamar grid, make sure you have a validated checkpoint.
Generate the required documentation as described in Generating the EMC Avamar server shutdown
documentation.
Procedure
1 Using winscp, copy the avshutdown.pl script onto the /tmp folder of the EMC Avamar Utility
node or single node server.
2 Complete the following sections from the Avamar Data Store Shutdown Procedure document:
31
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Integrated Data Protection
Note: Ignore any instructions to power the system back on, unless you wish to perform this
operation.
Related information
Procedure
a Open a console to the VMware Backup Appliance through the vSphere client.
b Log in as root.
d Once gsan shut down appears, power down the VMware Backup Appliance through the
vSphere Console using Power > Shutdown Guest.
Use this task to power down an EMC Data Domain system, including expansion shelves.
32
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Integrated Data Protection VCE Systems Powering On and Off Guide
If replication is enabled between the EMC Data Domain system to be powered down and another EMC
Data Domain system, disable replication on the partner system.
Procedure
33
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Integrated Data Protection
Procedure
1 To power on the VCE System that contains EMC VPLEX, follow this order:
a VCE System
If you have VMs stored on EMC VPLEX volumes that start automatically when the host starts,
they will not start until the EMC VPLEX system is running.
2 To power off the VCE System that contains EMC VPLEX, follow this order:
c VCE System
3 To power off EMC VPLEX, use the cluster shutdown and the director shutdown
commands, described in the EMC VPLEX GeoSynchrony 5.1 CLI Guide.
Procedure
1 To power on the VCE System that contains EMC RecoverPoint, follow this order:
a VCE System
34
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Integrated Data Protection VCE Systems Powering On and Off Guide
b VCE Integrated Data Protection solution that contains EMC VPLEX (if installed)
2 To power off the VCE System that contains EMC RecoverPoint, follow this order:
d VCE System
3 To power on/off EMC RecoverPoint, refer to EMC RecoverPoint Deployment Manager Release
1.1 Product Guide.
35
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Technology Extension for EMC Isilon Storage
Refer to the relevant procedure in this book for powering on the attached VCE System and note the
specific step that tells you when to power on the VCE Technology Extension.
Procedure
1 Power on the EMC Isilon InfiniBand switches in the VCE Technology Extension cabinet.
2 Power on the Cisco Nexus switches in the VCE Technology Extension cabinet.
3 Using a serial connection, connect to the console port of node 1 with a laptop and a
Hyperterminal or similar connection.
4 Power on node 1 first by pressing the power button located on the back of the node labelled
Node 1.
5 Monitor the status of the boot process for node 1. When node 1 has completed booting, it
displays the login prompt. Take note of any error codes or amber lights on the node. Resolve any
issues before moving to node 2.
7 Repeat the procedure for each node in the cluster (in sequential order). When all nodes have
completed booting, the system is powered on.
What to do next
36
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Technology Extension for EMC Isilon Storage VCE Systems Powering On and Off Guide
This task describes how to power off the VCE Technology Extension.
• Refer to the relevant procedure in this publication for powering off the attached VCE System and
note the specific step that tells you when to power off the VCE Technology Extension.
• Look at the back panel and confirm that the LEDs on both batteries are green. If either battery is
red, it has failed and must be removed from the node. If both batteries are red, replace and verify
them before shutting down the node.
Procedure
2 Click CLUSTER MANAGEMENT > Hardware Configuration > Shutdown & Reboot Controls.
4 Click Submit.
5 Power off the Cisco Nexus switches in the VCE Technology Extension cabinet.
6 Power off the EMC Isilon InfiniBand switches in the VCE Technology Extension cabinet.
What to do next
• Verify that all nodes have shut down by looking at the power light indicators on each node.
If the node still does not respond, press the Power button on the node three times, and wait five minutes.
If the node still does not shut down, press and hold the Power button until the node powers off.
Note: Perform a forced shutdown only with a failed and unresponsive node. Never force a shutdown with
a healthy node.
37
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VCE Technology Extension for EMC Isilon Storage
Note: Do not attempt any hardware operations until the shutdown process is complete. The process is
complete when the node LEDs are no longer illuminated.
38
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VxRack™ System with FLEX VCE Systems Powering On and Off Guide
For each component that you power on, if you smell smoke or see fire, immediately power
off the component and call VCE ® Support for assistance.
Before powering on the VxRack System, make sure the following items are available:
• Physical infrastructure such as reliable power, adequate cooling, and core network access
Refer to the Cisco documentation at www.cisco.com for information about the LED indicators.
Customer-provided services, such as Active Directory, DNS, NTP, and so on, as well as physical
infrastructure, such as reliable power, adequate cooling, and core network access, must be available prior
to proceeding with any VxRack System power on activity.
Procedure
1 Ensure that the Power Distribution Unit (PDU) breakers are in the OPEN (OFF) positions.
If the breakers are not in the OPEN positions, use the small enclosed tool to press the small white
tab below each switch for the circuit to open. These switches are located below the ON/OFF
breaker.
3 Ensure that power is available to the PDUs and that the LEDs on each PDU display a number.
4 Close the PDU circuit breakers on all PDUs for Zone A by pressing the side of the switch that is
labeled ON. This causes the switch to lie flat.
Ensure that all of the components that are connected to the PDUs on Zone A light up.
5 Close the PDU circuit breakers on all PDUs for Zone B by pressing the side of the switch that is
labeled ON. This causes the switch to lie flat.
Ensure that all of the components that are connected to the PDUs on Zone B light up.
39
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VxRack™ System with FLEX
6 Power on the network components in the following order. The network components take about 10
minutes to power on.
a Management switches—Wait until the PS1 and PS2 LEDs are solid green before proceeding.
b Cisco Nexus aggregation switches-Wait until the system status LED is green before
proceeding.
a Power on the VxRack Controllers. Verify that they have booted correctly and have network
connectivity. (To verify, make sure VMware ESXi has booted and that you can ping the
management IP address. Allow up to 20 minutes for the VxRack Controllers to boot once
VMware ESXi loads.)
b Use SSH to access each VxRack Controller and exit maintenance mode by typing esxcli
system maintenanceMode set –e false
c Log on to VxRack Controller A through the vi client and verify that the DNS, PSC1, VMware
vCenter, and Jump VM are installed . If the components are not on Controller A, verify that
the components exist on VxRack Controller B and/or C.
d Power on the DNS, PSC1, and VMware vCenter VMs. Verify that they have started
completely and have network connectivity.
e Log on to the vCSA web client and perform a VSAN health check. Also ensure no
components are resyncing.
f Power on the PSC2 VM. Verify that it has started completely and has network connectivity.
iv SQL Server
vi ScaleIO Gateway
h Enable High Availability (HA), Distributed Resource Scheduler (DRS), and Affinity Rules.
40
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VxRack™ System with FLEX VCE Systems Powering On and Off Guide
d Power on the five MDM Cluster SVMs (Primary, two Slaves and two Tie Breakers). Allow up
to three minutes for them to start. Once they are online, start the remainder of the SVMs.
e From the VxRack Controller jump server, log on to the EMC ScaleIO GUI and verify that all
software-defined storage (SDS) is online. Verify that all disks are online.
Note: VMs might appear inaccessible because ScaleIO storage is not available until the
power up of the ScaleIO VMs is complete.
Note: There may be an error message relating to the EMC ScaIeIO Protection Domain. This
is expected behavior while the system is coming online.
f Click Backend > Protection Domain > Activate and repeat for each protection domain.
h Mount the previously unmounted datastores, and add the VMs back to the inventory.
Procedure
2 Launch the EMC ScaleIO GUI and log on to the Primary MDM. Validate that the ScaleIO System
is healthy and no rebuild or rebalances are running.
4 Expand the Customer clusters. Shut down all VMs running on the EMC ScaleIO Storage LUN/
Datastores and remove them from the inventory.
41
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide VxRack™ System with FLEX
Note: VMs appear inaccessible during this process. This is expected behavior.
Do not shut down the EMC ScaleIO VMs. Shutting down EMC ScaleIO VMs at
this time can result in data loss.
6 From the EMC ScaleIO GUI, Click Backend > Protection Domain > Inactivate Protection
Domain. Repeat for each protection domain, and verify that each is deactivated.
8 From the VMware vSphere Web Client, shut down all the EMC ScaleIO VMs (including the five
MDM cluster).
11 Use SSH to access any Red Hat Storage nodes and use shutdown -h to power off.
12 Using the VMware vSphere Web Client, validate that the VSAN is healthy and that there are no
alerts or error messages. Select VXRC cluster and disable DRS, HA, and the Affinity rules on the
Controller Cluster.
13 Migrate all VMs to VxRack Controller A, and log off the VMware vSphere Web Client.
15 Log on to VxRack Controller A through thick client and shut down all VMs in the following order:
b Vision
c VUM Server
d SQL Server
e vCSA
f PSC2
g PSC1
42
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VxRack™ System with FLEX VCE Systems Powering On and Off Guide
16 Place each VxRack Controller into maintenance mode with the ESXCLI through SSH (not the
VMware vSphere Web Client) by typing esxcli system maintenanceMode set –e true
–m noAction.
18 Power off the Cisco Nexus switches and then the management switch.
19 On Zone B (BLUE), turn off all POU power breakers (OPEN position).
20 On Zone A (RED), turn off all POU power breakers (OPEN position).
Note: To ensure that there is no power beyond the POUs, disconnect the AC feeds to all POUs.
The VCE Systems ™ Physical Planning Guide contains additional information about
power specifications.
43
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
VCE Systems Powering On and Off Guide References
References
Refer to the following documentation for more information. (Authentication may be required to access
these documents.)
Cisco 3900 Series and Cisco 2900 Series Hardware EMC Avamar
Installation Guide
Cisco Catalyst 4900M Switch Installation Guide EMC CLARiiON CX4 Model 480
Cisco Nexus 1000V Series Switches Installation Guides EMC Data Domain
Cisco Nexus 1000V Series Switches Installation Guides EMC Isilon InfiniBand
Cisco Nexus 5000 Series Hardware Installation Guide EMC Isilon NL-Series platform
Cisco UCS 5108 Server Chassis Hardware Installation EMC Symmetrix VMAX 10K Series
Guide
Cisco UCS C200 Server Installation and Service Guide EMC Symmetrix VMAX 20K Series
EMC VPLEX
44
© 2011–2016 VCE Company, LLC.
All Rights Reserved.
www.vce.com
About VCE
VCE, an EMC Federation Company, is the world market leader in converged infrastructure and converged solutions. VCE
accelerates the adoption of converged infrastructure and cloud-based computing models that reduce IT costs while improving
time to market. VCE delivers the industry's only fully integrated and virtualized cloud infrastructure systems, allowing
customers to focus on business innovation instead of integrating, validating, and managing IT infrastructure. VCE solutions
are available through an extensive partner network, and cover horizontal applications, vertical industry offerings, and
application development environments, allowing customers to focus on business innovation instead of integrating, validating,
and managing IT infrastructure.
Copyright 2011–2016 VCE Company, LLC. All rights reserved. VCE, VCE Vision, VCE Vscale, Vblock, VxBlock, VxRack,
VxRail, and the VCE logo are registered trademarks or trademarks of VCE Company LLC. All other trademarks used herein
are the property of their respective owners.
45
© 2011–2016 VCE Company, LLC.
All Rights Reserved.