Oracle Exalogic Elastic Cloud

2.x: System Administration

Student Guide

D77799GC20
Edition 2.0
April 2014
D85909

Author
TJ Palazzolo
Technical Contributors
and Reviewers
Jose Alvarez
Diganta Choudhury
Rick Eppstein
James He
Albert Leigh
David Mills
Abbas Mir
Angus Myles
Julian Ortiz
Mike Palmeter
Kevin Tate
Dave Winter
Paul Wickstrom
Editors
RashMalavika Jinka
Vijayalakshmi Narasimhan
Anwesha Ray
Graphic Designer
Rajiv Chandrabhanu
Publishers
Syed Ali
Nit Brozowski
Nita
B
ki
Sujatha Nagendra

Copyright 2014, Oracle and/or its affiliates. All rights reserved.

Disclaimer
This document contains proprietary
y information and is protected by
y copyright
y g and
other intellectual property laws. You may copy and print this document solely for your
own use in an Oracle training course. The document may not be modified or altered
in any way. Except where your use constitutes "fair use" under copyright law, you
may not use, share, download, upload, copy, print, display, perform, reproduce,
publish, license, post, transmit, or distribute this document in whole or in part without
the express authorization of Oracle.
The information contained in this document is subject to change without notice. If you
find any problems in the document, please report them in writing to: Oracle University,
500 Oracle Parkway, Redwood Shores, California 94065 USA. This document is not
warranted
t d to
t be
b error-free.
f
Restricted Rights Notice
If this documentation is delivered to the United States Government or anyone using
the documentation on behalf of the United States Government, the following notice is
applicable:
U.S. GOVERNMENT RIGHTS
The U.S. Governments rights to use, modify, reproduce, release, perform, display, or
disclose these training materials are restricted by the terms of the applicable Oracle
license agreement and/or the applicable U.S. Government contract.
Trademark Notice
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names
may be trademarks of their respective owners.

Contents

Course Overview
Course Objectives 1-2
Target Audience 1-3
Introductions 1-4
Course Schedule 1-5
Course Practices 1-6
Classroom Guidelines 1-7
For More Information 1-8
Related Training 1-9

The Exalogic Solution

Objectives 2-2
Why Data Centers? 2-3
Data Center Challenges 2-4
What Is Exalogic Elastic Cloud? 2-5
What Is InfiniBand? 2-7
Why Exalogic? 2-8
Engineered Solution 2-9
High Availability 2-10
Multitenancy 2-11
Cloud Computing 2-12
Self-Service 2-13
Infrastructure as a Service (IaaS) 2-14
Server Virtualization 2-15
What Is Oracle VM (OVM)? 2-16
What Is Exalogic Control? 2-17
Selecting a Host Operating System 2-18
Physical Versus Virtual Data Center 2-19
Selecting a Guest Operating System 2-21
Hybrid Data Center 2-22
What Is Oracle Exabus? 2-23
Exalogic Versioning 2-24
What Is Exadata? 2-25
What Is SPARC SuperCluster? 2-26
Quiz 2-27

iii

Summary 2-30
3

Hardware Components
Objectives 3-2
Exalogic Machine Topology 3-3
Compute Nodes 3-4
Compute Node: Front View 3-5
Compute Node: Rear View 3-6
Storage Appliance 3-7
Storage Caching 3-8
Storage Appliance: Front View 3-9
Storage Appliance: Rear View 3-10
InfiniBand (IB) Switches 3-11
Gateway Switch Hardware Views 3-12
IB Host Channel Adapter (HCA) 3-13
IB Transceivers and Cables 3-14
Management Switch 3-15
Scaling Your Data Center 3-16
Comparing Rack Configurations 3-18
Power Options 3-19
Hardware Maintenance 3-20
Quiz 3-21
Summary 3-25

Initial Machine Configuration

Objectives 4-2
Initial Configuration Road Map 4-3
Installation Process: Overview 4-4
Using Oracle Installation Services 4-5
Power-On Procedure 4-6
Exalogic Online Checklists 4-7
Example: Access Route Checklist 4-8
Site Requirements 4-9
Exalogic Configuration Utility (ECU) 4-10
ECU Inputs 4-11
Initial Configuration Road Map 4-12
IP over InfiniBand (IPoIB) Networks 4-13
Ethernet over InfiniBand (EoIB) Networks 4-14
Integrated Lights Out Manager (ILOM) 4-15
ILOM Network 4-16
Network Configuration Worksheets 4-17

iv

Exalogic Networks, Physical Configuration 4-18

Default IP Addresses and Host Names, Physical Configuration 4-19
ECU Spreadsheet, Physical Configuration 4-20
Exalogic Networks, Virtual Configuration 4-21
Default IP Addresses, Virtual Configuration 4-23
ECU Spreadsheet, Virtual Configuration 4-24
Bonded Interfaces 4-25
Initial Configuration Road Map 4-26
Exalogic Storage Concepts 4-27
Default Storage, Physical Configuration 4-28
Default Storage, Virtual Configuration 4-29
Default Compute Node Mounts 4-30
Initial Configuration Road Map 4-31
Diagnostic Utilities 4-32
Utility Examples 4-34
Distributed Command Line Interface (DCLI) 4-35
DCLI Examples 4-36
Quiz 4-37
Summary 4-40
Practice 4-1: Connect to a Compute Node 4-41
5

Managing Hardware with ILOM

Objectives 5-2
ILOM Tasks 5-3
Review: ILOM Network 5-4
Sideband Management 5-5
Accessing the Browser Interface 5-6
Configuring Network Settings 5-7
Configuring Management Access 5-8
Changing the ILOM Root Password 5-9
Adding ILOM Users 5-10
ILOM Profiles, Roles, and Privileges 5-11
Powering the Device On or Off 5-12
Locating the Device in the Data Center 5-13
Updating Device Firmware 5-14
Viewing Hardware Status and Specifications 5-15
Monitoring Power Consumption 5-16
Analyzing Power Consumption 5-17
Limiting Power Consumption 5-18
Alert Concepts 5-19
Configuring Alerts 5-20

Connecting to the Host OS 5-21

Accessing the Command-Line Interface (CLI) 5-22
CLI Examples 5-23
Quiz 5-24
Summary 5-26
Practice 5-1: Use Compute Node ILOM 5-27
6

Managing Hardware with Exalogic Control

Objectives 6-2
Review: Exalogic Control 6-3
Exalogic Control Architecture 6-4
Management Scope 6-5
Starting and Stopping Exalogic Control 6-6
Exalogic Control Role Hierarchy 6-8
Exalogic System Administrator 6-9
User Directory Options 6-10
Working with Local Users 6-11
Accessing the Browser Interface 6-12
Interface Layout 6-13
Navigation Drawers 6-14
Creating an Exalogic System Administrator 6-15
Searching for Resources 6-16
Navigating Exalogic Assets 6-17
Viewing Exalogic System Specifications 6-18
Navigating the System Topology 6-19
Viewing Exalogic System Networks 6-20
Viewing Rack Specifications 6-21
Navigating Rack Slots 6-22
Monitoring Rack Power Consumption 6-23
Navigating All Networks 6-24
Navigating the Network Topology 6-25
Maintaining and Troubleshooting Assets 6-26
Managing Assets 6-27
Monitoring Asset Hardware 6-29
Reports 6-30
Report Types 6-31
Creating an Exalogic System Report 6-32
Policies, Alerts, Incidents, and Notifications 6-33
Viewing Monitoring Policies 6-34
Viewing Incidents 6-35
Working with Incidents 6-36

vi

Quiz 6-37
Summary 6-41
Practice 6-1: Use Exalogic Control 6-42
7

Storage Configuration
Objectives 7-2
Storage Configuration Road Map 7-3
ZFS Appliance Capabilities 7-4
Getting Started 7-5
Accessing the Browser User Interface (BUI) 7-6
Changing the Root Password 7-7
Creating New Administrative Users 7-8
Roles and Authorizations 7-9
Viewing Appliance Status 7-10
Configuring Network Settings 7-12
Storage Pool 7-13
Monitoring Hardware 7-14
Replacing Failed Hardware 7-16
Performing Failover Actions 7-17
System Maintenance 7-18
Rolling Updates 7-19
Storage Configuration Road Map 7-20
Review: Exalogic Storage Concepts 7-21
Some Storage Services 7-22
Example: Configuring the FTP Service 7-23
Creating a Project 7-24
Creating a Share in a Project 7-26
Overriding Project Defaults 7-27
Setting Quotas 7-28
Restricting Share Access 7-29
Review: CIDR Notation 7-30
Exalogic NFS Architectures 7-31
NFS v3 Versus NFS v4 7-32
Configuring NIS on the Storage Appliance 7-33
Configuring LDAP on the Storage Appliance 7-34
Configuring a Compute Node or vServer for NFS 7-36
Example: Configuring NIS on Linux 7-37
Mounting an NFS Share 7-38
Storage Configuration Road Map 7-39
Storage Command-Line Interface (CLI) 7-40
Some CLI Commands 7-41

vii

CLI Examples 7-42

Storage Scripting 7-43
Script Example 7-44
Monitoring Storage with Exalogic Control 7-45
Accessing Storage Tools from Exalogic Control 7-46
Quiz 7-47
Summary 7-50
Practice 7-1: Configure Shared File Systems 7-51
8

Network Configuration
Objectives 8-2
Network Configuration Road Map 8-3
Review: Exalogic InfiniBand (IB) Networks 8-4
Eighth-Rack Network Topology 8-5
Quarter-Rack Network Topology 8-6
Half-Rack Network Topology 8-7
Full-Rack Network Topology 8-8
Exalogic Multi-Rack Topology 8-9
Exalogic Quarter Rack and Exadata Quarter Rack 8-10
Exalogic Full Rack and Exadata Full Rack 8-11
Review: Transceivers and Cables 8-12
Network Configuration Road Map 8-13
Status LEDs 8-14
Replacing Failed Hardware 8-15
IB Switch Command-Line Interface (CLI) 8-16
Switch ILOM Targets 8-17
Changing Switch Passwords 8-18
Monitoring the Hardware 8-19
Monitoring Connection Status 8-21
Running IB Diagnostics 8-23
Subnet Manager (SM) Concepts 8-24
Subnet Manager Recommendations 8-25
Monitoring the Subnet Manager 8-26
Network Configuration Road Map 8-27
Multitenancy Overview, Virtual Configuration 8-28
Multitenancy Overview, Physical Configuration 8-29
InfiniBand Partition 8-30
Partition Membership 8-31
Working with Partitions, Physical Configuration 8-33
Updating the Default Partition 8-34
Locating Port Identifiers 8-35

viii

Creating a New Partition 8-36

Associating Partitions with Compute Node Network Interfaces 8-37
Associating Partitions with Storage Appliance Network Interfaces 8-38
Virtual NIC (VNIC) 8-39
Creating a VNIC 8-40
Virtual LAN (VLAN) 8-41
Tagging a Gateway Port with a VLAN ID 8-42
Tagging a VNIC with a VLAN ID 8-43
Network Configuration Road Map 8-44
Review: Navigating Networks in Exalogic Control 8-45
Monitoring Switch Ports in Exalogic Control 8-46
Viewing Historical Data in Exalogic Control 8-48
Accessing the Switch Console in Exalogic Control 8-49
Switch Fabric Monitor 8-50
Monitoring the Hardware and Subnet Manager 8-51
Monitoring Ports 8-52
Quiz 8-53
Summary 8-57
Practice 8-1: Access an InfiniBand Switch 8-58
9

Lifecycle Management
Objectives 9-2
Exalogic Lifecycle Toolkit 9-3
Installing the Toolkit 9-4
Lifecycle Management Road Map 9-5
Exachk 9-6
Validation Criteria 9-7
Configuring Exachk 9-8
Running Exachk 9-9
Health Check Report 9-10
Lifecycle Management Road Map 9-12
Automatic Service Request (ASR) Framework 9-13
ASR Architecture 9-14
Activating Compute Nodes 9-15
Activating the Storage Appliance 9-16
ExaLogs 9-17
Diagnostic Bundle Contents 9-18
Configuring ExaLogs 9-19
Running ExaLogs 9-20
Lifecycle Management Road Map 9-21
Backup Recommendations 9-22

ix

ExaBR 9-23
Backup Contents 9-24
Configuring ExaBR 9-25
Taking a Backup 9-27
Restoring a Backup 9-28
Starting and Stopping Exalogic Control 9-29
Quiz 9-30
Summary 9-32
Practice 9-1: Install and Use Lifecycle Tools 9-33
10 Disaster Recovery
Objectives 10-2
Review: Exalogic High Availability 10-3
Disaster Recovery (DR) 10-4
Disaster Recovery Topology 10-5
Site Symmetry 10-6
Recommended Architecture 10-7
General Best Practices 10-8
Disaster Recovery Configuration Checklist 10-9
Hosts File: Example 10-10
Exalogic Storage Replication 10-11
Storage Replication Modes 10-12
Storage Replication Channel 10-13
Recommended Storage Network Topology 10-14
Storage Networking Terminology 10-15
Creating a Datalink for Replication 10-16
Creating an Interface for a Datalink 10-18
Creating an IPMP Interface 10-19
Configuring a Gateway Address for an Interface 10-20
Creating a Replication Target 10-21
Configuring Replication for a Project 10-22
On-Demand Replication 10-24
Enterprise Manager Cloud Control 10-25
Oracle Site Guard 10-26
Quiz 10-27
Summary 10-30
Related Training 10-31