You are on page 1of 60

IBM Storage Integration with OpenStack

Tony Pearson
Master Inventor and Senior Software Engineer
IBM Corporation
Abstract

This session will explain OpenStack, cover an overview of


Software Defined Environments, and the integration of IBM
Storage with OpenStack solutions.

© Copyright IBM Corporation 2016. Technical University/Symposia materials 2


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
This week with Tony Pearson

Day Time Topic


Tuesday 11:30 Software Defined Storage -- Why? What? How?

Wednesday 10:15 IBM Spectrum Protect Overview

13:45 What Is Big Data?


Architectures and Practical Use Cases
15:00 Storage Tiering on z System:
Less Management Lower Cost and Increased Performance

Thursday 09:00 Business Continuity and Disaster Recovery


for z System storage
11:30 IBM Spectrum Virtualize:
Understanding SVC, Storwize and FlashSystem V9000
15:00 IBM Storage integration with OpenStack

© Copyright IBM Corporation 2016. Technical University/Symposia materials 3


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Agenda

Why use OpenStack?


OpenStack Architecture
Block-level Storage
File and Object Storage
Software Defined – Cloud Operating Environment – OpenStack

API
Economy

Cloud Operating
Environment

Software
Defined
Infrastructure

© Copyright IBM Corporation 2016. Technical University/Symposia materials 5


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
One Person – One Handheld Device

Requirements
User / Administrator • Does this device have
everything I need to run my
applications?

Operating
System

Compute Storage Utilities Network


• CPU • Persistent • Passwords • Wi-Fi
• DRAM Flash or Disk • Usage Statistics • 4G-LTE
© Copyright IBM Corporation 2016. Technical University/Symposia materials 6
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
One Family – One Personal Computer

Users Wizards Orchestration Scripts User /


(Family Administrator
members) Graphical User Command Line
Interface (GUI) Interface (CLI)

Compute
• Do I have enough Network
CPU and Memory • Do I need to use
to play games? VPN to get to
Utilities work? Do I need to
Storage • Do I need to filter what sites my
• Do I have enough capacity to store my control or monitor children can
family photos, videos and music? Do I what my children access?
need external storage for backups? see and do?
© Copyright IBM Corporation 2016. Technical University/Symposia materials 7
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
One Department – One Workplace

System
Admin

Users

eMail

Spam Filter
Anti-Virus Checking

Filewall
Web Cache
Storage Area Network (SAN) Identity
Management Local Area
Flash Network (LAN)
Disk
Usage
Tape
Statistics

© Copyright IBM Corporation 2016. Technical University/Symposia materials 8


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Today’s Datacenter Environment

Users
Server
Admin

Application LAN
owners

SAN
Network
Admin

Storage Facilities
Admin
© Copyright IBM Corporation 2016. Technical University/Symposia materials 9
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
How is Software Defined Environment different?
Application Owner
Applications…
Business Requirements

APIs
Orchestration
Service Levels

Control
Server Automate Your Workloads Plane

Management
Simplified
Admin
Storage
Optimize Your Resources
Admin Data
Network Compute Storage Network
Plane
Admin
Standard Interfaces
Provisioning
Virtualization

Infrastructure…
Facilities Servers, Storage, Networks
© Copyright IBM Corporation 2016. Technical University/Symposia materials 10
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Control Plane vs. Data Plane
Control Plane

Resource Pools Service Catalog


and Quotas Data Plane Quality of Service (QoS)
© Copyright IBM Corporation 2016. Technical University/Symposia materials 11
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM is Focused on these Software Defined Environments

OpenStack IBM Cloud Orchestrator x86-based

IBM is a platinum sponsor of IBM offerings are based on VMware and Microsoft are
OpenStack Foundation OpenStack open source code with entirely proprietary, but have a
value-added proprietary large market share for x86-based
features from IBM server infrastructure
OpenStack open source code
can manage IBM compute,
network and storage resources IBM Cloud Orchestrator IBM was VMware’s first OEM and
OpenStack supports x86, POWER supports a variety of server joint development partner (since
Systems and z System mainframe hypervisors. IBM BlueBox and 1998) IBM Global Services is one
IBM PowerVC provide additional of VMware’s largest customers
features
IBM offers OpenStack Cinder
interfaces on most of its major IBM and Microsoft agreement to
storage products and OpenStack IBM Spectrum Control™ provide offer SQL Server and .NET on
Swift interfaces for object access reporting, provisioning, trouble IBM Cloud and IBM software on
shooting and chargeback Microsoft Azure
capabilities
“Some assembly required” Enterprise-ready out of the box
x86, POWER systems and z System mainframe Concerns about vendor lock-in
© Copyright IBM Corporation 2016. Technical University/Symposia materials 12
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Software Defined Control and Deployment

Administrator-
Controlled Software-Controlled
How is it controlled?
• ProtecTIER appliance • IBM Spectrum Industry-Standard
and gateway Storage™ family Hardware

How is it deployed?
• LTFS software with • XIV storage system • Software
LTO tape drives • Elastic Storage
• Pre-built systems
Server
• IBM Cloud Object • Cloud services
III Storage System IV
• Enterprise Tape drives • FlashSystem Specialized Hardware
and libraries • Storwize with Intel • Co-processors
QuickAssist • ASICs, FPGAs
• DS8000
• Adapters
I II

© Copyright IBM Corporation 2016. Technical University/Symposia materials 13


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Different Clients have a Different Focus for Software Defined

Cloud and
Managed Service
Focus:
Providers
Industry-standard HW

• Focus on industry-standard x86 and OpenPOWER servers


that can be quickly re-purposed
• Offer services based on advanced software Focus:
that can be deployed as needed on existing Software
industry-standard rack-optimized equipment Controls
• Predictable, consistent performance

• Focus on Software APIs to simplify,


automate and control existing investments
• Use specialized hardware to provide optimal
performance for mission-critical applications
Data Centers
© Copyright IBM Corporation 2016. Technical University/Symposia materials 14
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
One Dashboard – One Cloud

Users,
OpenStack software controls large pools of
Developers,
compute, storage and networking resources
Administrators
throughout a datacenter, managed through a
dashboard or via the OpenStack API

Dashboard
• GUI and CLI interfaces
• Orchestration • Private Cloud
• Public Cloud
• Hybrid Cloud

Compute Storage Shared Services Network


• Hypervisors • Volumes • Identity management • Focused on
• Virtual Machines • Objects for users/passwords TCP/IP based
• VM images • File Systems • Usage Statistics networks
• Bare metal Metering
© Copyright IBM Corporation 2016. Technical University/Symposia materials 15
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack Cloud Management Software

OpenStack is a global collaboration of developers & cloud computing technologists


working to produce an ubiquitous Infrastructure as a Service (IaaS) open source
cloud computing platform for public & private clouds.

Platinum Sponsors

60% of respondents
stated that they already
Design Tenets… use or plan to use
•Scalability and elasticity are main goals OpenStack cloud
•Share nothing, distribute everything (asynchronous and computing software
horizontally scalable) -- Published date: 03/18/2015
Source: IDC
•Any feature that limits our main goals must be optional
•Accept eventual consistency and use it where appropriate
http://openstack.org
© Copyright IBM Corporation 2016. Technical University/Symposia materials 16
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM is committed to OpenStack with contributions and added value

Deliver Management Solutions


IBM Cloud Orchestrator
IBM BlueBox
IBM PowerVC
IBM Spectrum Control IBM OpenStack Platform

Perform Optimizations HEAT Orchestration TOSCA


Live upgrades
Security and authentication
OVF Images OpenStack IaaS APIs
Membership services
Globalization translation integration
QA enhancements IBM Contributions

IBM Unique Value

Contribute Platform Support


PowerKVM, KVM, z/VM Nova Cinder Swift Manila Neutron
IBM DS8000, Storwize, SVC, XIV
Drivers Drivers Drivers Drivers Drivers
IBM Spectrum Scale
IBM SDN for VE, OpenFlow Switches

© Copyright IBM Corporation 2016. Technical University/Symposia materials 17


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Agenda

Why use OpenStack?


OpenStack Architecture
Block-level Storage
File and Object Storage
OpenStack terminology – Core Components

Horizon Heat
• OpenStack • Orchestration,
dashboard, a coordinate the
web application deployment of
that runs on resources for
Apache an application

Compute Storage Shared Services Network


Nova
• Hypervisors Cinder
• VM instances • Volumes
Keystone Neutron
• Policy and authentication
Swift • VPN
Glance • Objects
services, users and passwords
• Firewall
• VM images • Load
• Disk images Ceilometer Balancing
Manila • Usage Statistics
• File systems Metering
© Copyright IBM Corporation 2016. Technical University/Symposia materials 19
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack terminology – Compute

x86 systems VMware, Hyper-V, KVM, Xen,


Nova Docker, Linux Containers LXC
• Hypervisors POWER Systems PowerVM, PowerKVM, Docker
• VM instances
z Systems z/VM, Docker, zKVM (TBD)

Glance
Disk formats: • VM images Container formats:
raw, vhd, vmdk, vdi, iso, • Disk images bare, ovf, ova, aki, ari, ami
qcow2, aki, ari, ami

File System
Amazon S3
or
Swift HTTP
• Objects

© Copyright IBM Corporation 2016. Technical University/Symposia materials 20


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack terminology – Storage

Create, Delete and Extend volumes; take snapshots, images


and clones; attach/detach from VM instances
Cinder
• Volumes
Block Volume-
LUN on-file

Create and Delete containers and


Swift objects – Storing an object is like
• Objects “valet parking” your data

Object- Key/Value
on-file Store

Manila
• File systems Provides coordinated access to shared or distributed file
systems. The primary consumption of file shares would be
across OpenStack Compute instances.
© Copyright IBM Corporation 2016. Technical University/Symposia materials 21
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack terminology – Telemetry

© Copyright IBM Corporation 2016. Technical University/Symposia materials 22


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack terminology – Network

Flat mode All Instances are attached to a single Linux bridge


IP addresses are injected into image on launch
Flat DHCP Similar to Flat Mode with DHCP for IP addresses
Neutron
• TCP/IP VLAN Fixed IP Subnet and Linux bridge per tenant
based Switch must support 802.1Q VLAN tagging
networks
VXLAN Software or Hardware VTEPs
(default) VMware NSX, PLUMgrid, ML2 plugin

Load Balancing Firewall Virtual Private Network (VPN)


HA Proxy support Separate FW service IPsec support
Vendor specific IP tables support Site-to-Site and Single-to-
framework in place Multi-site configurations
© Copyright IBM Corporation 2016. Technical University/Symposia materials 23
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Agenda

Why use OpenStack?


OpenStack Architecture
Block-level Storage
File and Object Storage
Cinder - OpenStack Block Storage Architecture

• Enables persistent data store for VMs


• Nova instance disks are ephemeral, deleted when the instance is deleted
• Cinder Volume lifecycle is independent of VM
• Supports creating (Thin or Thick), attaching, detaching, deleting, sync replication
• Volumes are primarily, but not limited to Block storage in the back-end
• (also NAS, File Systems)
• Supports space-efficient snapshots, cloning (full copy), backup and Consistency
Groups
Nova Compute node Cinder node

Nova Cinder

VM VM
Instance Instance

Storage Controller
Local Storage

Legend
Image control Persistent volume control
Image data Persistent volume data
© Copyright IBM Corporation 2016. Technical University/Symposia materials 25
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack Support for Volumes

Cinder • Create, Delete and Extend volumes


• Volumes • Take snapshots (FlashCopy), images and clones
• Attach and Detach to/from VM instances

Backup
Support

Control

IBM Spectrum Virtualize IBM Spectrum


SVC, Storwize, FlashSystem V9000 IBM Spectrum
Control Protect

SAN IBM Spectrum


Scale

FlashSystem DS8000
900
IBM Spectrum Hundreds of IBM and non-IBM
XIV Accelerate
flash and disk systems that
may not offer native
OpenStack Cinder support
© Copyright IBM Corporation 2016. Technical University/Symposia materials 26
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
DS8880 and XIV OpenStack Cinder – Capabilities

• Capabilities in Liberty Cinder Driver (1.6.0)


• Create/Delete Volume
• Volume Attach/Detach (via Nova Compute)
• Snapshots, Clones (FlashCopy with background copy)
• Backups (Copy Volume Images to Object Store)
• Swift, Ceph and TSM Support
• Volume Types, Volume Retype
• Quotas
• Consistency Groups for FlashCopy
• Volume Retype – Ability to change the type of an
existing Cinder volume to a new tier, add capabilities,
etc.
• Volume Replication – Ability to do synchronous
replication of cinder volumes between two storage
subsystems

http://docs.openstack.org/liberty/config-reference/content/ibm-xiv-driver.html https://wiki.openstack.org/wiki/CinderSupportMatrix

Download and install the package available at: https://www-


933.ibm.com/support/fixcentral/swg/selectFixes?product=ibm/Storage_Disk/DS8870&release=All&platform=All&function=all
© Copyright IBM Corporation 2016. Technical University/Symposia materials 27
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Managing IBM Storwize V7000 and Spectrum Virtualize with
OpenStack
“Managing IBM Storwize V7000 Storage with OpenStack”
http://www.youtube.com/watch?v=JWMm6-zwrMw

OLTP DB workload Web workload for


on OpenStack media on
compute OpenStack compute

Tier 1 Tier 1b Tier 2 Tier 2c

IBM Storwize V7000


SSD/HDD Pool
SSD Pool
Real-time
Compression
Easy Tier Easy Tier
Enabled Disabled
© Copyright IBM Corporation 2016. Technical University/Symposia materials 28
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Service Class Based Provisioning

© Copyright IBM Corporation 2016. Technical University/Symposia materials 29


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the IBM
© Copyright priorCorporation
written permission
2015 of
IBM.
Agenda

Why use OpenStack?


OpenStack Architecture
Block-level Storage
File and Object Storage
Manila – OpenStack File Storage Architecture

Provide VMs 1 and 2


access to the R&D file share

Compute node Compute node


Create Marketing
file share between
VM 1 and 4
Nova Nova
VM VM
VM 1
Instance VM 2
Instance
Instance 3 Instance 4

• Provides shared file system services for VMs


• Vendor-neutral API for NFS/SMB and other
network file systems
Controller or Finance R&D Marketing

• IBM Spectrum Scale Manila driver Compute


Shares Provider
node(s)
• Extends Spectrum Scale data plane into VM
Ganesha or kNFS
• Supports both kNFS and Ganesha 2.0 NFS
• Create/list/delete Shares and Snapshots IBM Spectrum Scale

• Allow/deny access to a share based on IP


address

SSD Fast Slow Tape


http://docs.openstack.org/developer/manila/devref/gpfs_driver.html Disk Disk
© Copyright IBM Corporation 2016. Technical University/Symposia materials 31
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Swift - OpenStack Object Storage Architecture

• Massively scalable redundant storage


system
• Can be scaled as needed based on projected
workloads
• Default: 3-way replication
• Data replication and integrity across the cluster
• Proxy Servers:
• Proxy Servers are the public face of OpenStack
Swift
• Handle all incoming API requests
• For each request, will look up the location of the
account, container, or object in the ring and
route the request accordingly
• OpenStack Swift public API is also exposed
through the Proxy Server
• Amazon S3 compatibility
• For a detailed support matrix, see
https://wiki.openstack.org/wiki/Swift/APIFeature
Comparison

© Copyright IBM Corporation 2016. Technical University/Symposia materials 32


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
How is Object Storage Different?

Block and File Storage Object Storage


– Decide where to put it – Provide data over to the Object storage
• For block, which array/volume/LUN • Get “claim stub” reference locator
• For file, which filer/subdirectory
– Use or share “claim stub” to access
– Remember where it is to get it back data HTTP, Openstack Swift, S3
– Read/Write records, append data – Get/Put/Delete object in its entirety
– Limits on LUN size, number of files – Effectively “unlimited” scalability
© Copyright IBM Corporation 2016. Technical University/Symposia materials 33
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Object Store for Unstructured data

Hot Data Object Store


High-IOPS and Low-Latency is not designed for
• High IOPS workflows
All-Flash and Hybrid Flash/Disk
• Transaction
Information Lifecycle Management Processing
(ILM) • Inherent ILM
Structured data / Random-Access
Active logs and traces
Virtual Machines and VDI
Single-Tenancy
Static and Stable data
Backups, Files, Archives
Seismic, Research, Telemetry, HPC
Object Store provides a
Video, Animation, Body Cams
• Secure Photos, Images, CAD/CAM, GIS
• Reliable Music, Audio
• Scalable Genomic, Medical Images
• Cost Effective Multi-tenancy
Platform For Unstructured data
© Copyright IBM Corporation 2016. Technical University/Symposia materials 34
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Volume vs. File vs. Object level access

POSIX NFS, SMB REST


Read record Read record Get, Put
Write record Write record Delete

Access Access
Control Control
List (ACL) List (ACL)
SAN Zoning, SCSI File Eventual
LUN Masking Reserve Locking Consistency

SAN Volume File LAN Object


or Read block LAN Read record or Get, Put,
LAN Write block Write record WAN Delete

• Device • Mount point


• Account
• LUN / Volser or Drive Letter
• Container
• Block ID • Path (subdirs)
• Object
• File name
© Copyright IBM Corporation 2016. Technical University/Symposia materials 35
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Object storage is dominant in cloud

IDC: Worldwide file- and object-based storage


2014–2018 Forecast (EB)

250

200

150

100

50

0
2012 2013 2014 2015 2016 2017 2018

File-based software, appliances, and gateways


Object-based software and appliances (includes self-built/SaaS/cloud NAS)

© Copyright IBM Corporation 2016. Technical University/Symposia materials 36


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack Support for Volume, File and Object

Glance Cinder Manila Swift Keystone


• VM images • Volumes • File systems • Objects • Access control
• Disk images

• Create, Delete and Extend volumes • Create and Delete containers in account
• Take snapshots (FlashCopy) and clones • Upload, Download and Delete objects
• Volumes Images, Images Volumes • List containers or objects in a container
• Attach and Detach to/from VM instances • Display and update metadata
Volume-on-file Object-on-file

Global Name Space

© Copyright IBM Corporation 2016. Technical University/Symposia materials 37


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Clustered Protocol Servers for File and Object access

Feature of IBM Spectrum Scale on


Linux nodes
TCP/IP
Share files with clients using NFS,
SMB and Object protocols
AIX, Linux, Mac OS,
Windows, VMware, All nodes can share the same data
z/OS, etc.
If Protocol Server Node fails,
client connections are moved to
NFS v3/v4 OpenStack
SMB2, SMB3 Amazon S3
another server
Protocol Server Node(s) need “NSD
Protocol Servers
Server” License
External clients need no Spectrum
Scale License
SAN Files can be accessed as objects,
objects can be accessed as files!
Twin-tailed
© Copyright IBM Corporation 2016. Technical University/Symposia materials 38
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM Spectrum Protect with OpenStack Swift storage

Client nodes

Off-premises:
• IBM SoftLayer

IBM Spectrum • OpenStack Swift


Protect Server
On-premises
© Copyright IBM Corporation 2016. Technical University/Symposia materials 39
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM for Software Defined Storage and Hybrid Cloud

IBM Software Defined Storage


Control Plane

Infrastructure should match your application


requirements
Control Protect

IBM Software Defined Storage OpenStack manages large pools of resources


Data Plane through dashboard and API

IBM Storage, including IBM Spectrum Storage


Accelerate Virtualize Scale Archive family of products, supports OpenStack
interfaces

IBM ranked #1 in Software


Defined Storage with
40% market share in 2014
© Copyright IBM Corporation 2016. Technical University/Symposia materials 40
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Session Evaluations

YOUR OPINION MATTERS!

1 2 3 4
Submit four or more session
evaluations by 5:30pm Wednesday
to be eligible for drawings!
*Winners will be notified Thursday morning. Prizes must be picked up at
registration desk, during operating hours, by the conclusion of the event.

© Copyright IBM Corporation 2016. Technical University/Symposia materials 41


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
© Copyright IBM Corporation 2016. Technical University/Symposia materials 42
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM is Open by Design
Don't build a dead-end cloud

Founding member and


Founding member and Leading the move toward open
Platinum Sponsor
platinum sponsor of the governance as Member of
Cloud Foundry Foundation Docker advisory board and
Built on OpenStack, the
Contributing significant code to
ubiquitous, massively
Built on Cloud Foundry, the the project
scalable open source IaaS
industry’s open PaaS that
platform:
provides choice of clouds, Supporting Docker, an open
frameworks and application platform to build, ship and run
• IBM Cloud Orchestrator
services: distributed applications:
• PowerVC
• BlueBox
• IBM Bluemix • IBM Container Service for
Bluemix
• Docker Hub Enterprise on
SoftLayer
• WebSphere Liberty Profile
Application Server
For more information visit
http://www.ibm.com/cloud-computing/us/en/open-cloud.html
© Copyright IBM Corporation 2016. Technical University/Symposia materials 43
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
The “IT Infrastructure Conversation”
IBM Institute for Business Value Study

The IBM Institute for Business Value (IBV), in conjunction with


Oxford Economics, surveyed 750 senior IT executives to learn
how prepared their IT infrastructures are to handle the changing
nature of business. We looked at how companies view the
importance of IT infrastructure, the investments they are making in
this space, and how they can better prepare for the future.
"IT infrastructure plays a vital role in our day-to-day
activities and business. It increases the ability of our
company to respond to a rapidly changing
marketplace through flexibility, efficiency and speed."
VP / Director IT Infrastructure, Retail

© Copyright IBM Corporation 2016. Technical University/Symposia materials 44


IBM Systems Technical Events
- | ibm.com/training/events
http://www-03.ibm.com/systems/infrastructure/us/en/it-infrastructure-matters/it-infrastructure-report.html
may not be reproduced in whole or in part without the prior written permission of
- http://www-01.ibm.com/common/ssi/cgi-
IBM.
bin/ssialias?subtype=ST&infotype=SA&appname=STGE_XB_XB_USEN&htmlfid=XBJ03072USEN&attachment=XBJ03072USEN.PDF#loaded
OpenStack Cloud Platform for IaaS
Technology Platform

The OpenStack project mission is to produce the ubiquitous Open Source Cloud
Computing platform that will meet the needs of public and private clouds regardless
of size, by being simple to implement and massively scalable.

Code available under Apache 2.0 license. Design tenets – scale and elasticity, share
nothing and distribute everything

© Copyright IBM Corporation 2016. Technical University/Symposia materials 45


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM Contributions to OpenStack: Road To Mitaka
Liberty
Havana Core Contributors: 32
Core Contributors: 13 Technical Mitaka
Juno
Technical Contributors: 187 Core Contributors: 42
Core Contributors: 15
Folsom Contributors: 85 Commits: 2172 Technical
Technical Contributors:
Core Contributors: 4 Commits: 1595 Blueprints: 44 Contributors: 212
109
Technical Contributors: Blueprints: 71 Projects: 204 Commits: 4308
Commits: 1669
18 Projects: 48 Key Contributions: Blueprints: 76
Blueprints: 48
Commits: 181 Key Contributions: Security Manageability Projects: 213
Projects: 78
Blueprints: 9 Enterprise Security Block Storage Key Contributions:
Key Contributions:
Projects: 20 Ceilometer Scalability Networking
Federated Identity
Key Contributions: Quality Assurance Dashboard Enhancements
Block Volume
Integration Tests Replication Enhancements Security
Crowd Sourced Dashboard Enhancements
Translation Enhancements Containers
Membership Services Enhancements
Kilo
Core Contributors: 22
Technical
Icehouse Contributors: 124
Grizzly Core Contributors: 14 Commits: 2084
Essex Core Contributors: 10 Technical Blueprints: 68
Core Contributors: 1 Technical Contributors: 107 Projects: 106
Contributors: 38 Commits: 1722 Key Contributions:
Technical
Commits: 961 Blueprints: 85 Federated Identity
Contributors: 2
Commits: 9 Blueprints: 35 Project: 61 36% of Magnum
Projects: 33 Key Contributions: commits
Blueprints: 0
Projects: 6 Key Contributions: Quality Assurance RefStack
API Stability Authentication &
Key Contributions:
Storage Enhancements Security 15% of
Chinese Translation Total IBMers
21% of Nova design Compute features
Nova Hygiene
Storage features Source http://www.stackalytics.com/
© Copyright IBM Corporation 2016. Technical University/Symposia materials 46
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
Enhancements IBM.
IBM is working to accelerate OpenStack success

Exponential growth
Because an open interoperable Cloud
Mar Apr
2013 2016
is critical for flexible cloud deployment
859 5113
and customer success…
Contributors Contributors
8,500 Members 31,454 Members

42 IBM has 42 core contributors


Platinum Sponsors Gold Sponsors

IBMers active developers in


+210 OpenStack projects

OpenStack Participant Growth


IBMers working on OpenStack
+500 – from formation of the Foundation
to Code Quality & New Function

http://activity.openstack.org/dash/browser
© Copyright IBM Corporation 2016. Technical University/Symposia materials 47
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
The market is recognizing the importance of OpenStack as an
important open technology

End-user organizations remain concerned about


cloud vendor lock-in, which is driving much of the
interest in OpenStack
Published date: 08/01/2014 Source: IDC

60% of respondents stated that they already use or


plan to use Openstack's cloud computing software
-- Published date: 03/18/2015 Source: IDC

OpenStack is here, and it’s ready. Eleven Fortune


100 firms (e.g., Best Buy, BMW, Comcast, Disney,
Wal-Mart) are already using OpenStack for
production environments, making its viability and
presence in the market irrefutable
-- Published date: 05/18/2015 Source: Forrester
Source: Forrester:
OpenStack is ready, Are
you? (May 18, 2015)
© Copyright IBM Corporation 2016. Technical University/Symposia materials 48
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM Contributions to Mitaka
#3 Reviewer #3 Committer 42 Core 3 of top 10
(10% of reviews) (11% Contributions) Contributors contributors

Identity (Keystone) Dashboard (Horizon)


• Improved translation support for dashboard plugins
• Domain specific roles (identity per domain policy • Angular based dashboard extensibility
enforcement) • New dashboard AngularJS plugin for creating and
• Enhance QA to test new deployment models managing LBaaS V2 resources
• Allow URL safe names for projects
• Retrieve default values of domain specific configuration Compute (Nova)
• Usability enhancements for Operators
Storage (Cinder & Swift) • Large number of bugs fixed
• Simplified configuration and scheduler improvements
• Cinder backend drivers storwize_svc, XIV and DS8k
replication Networking
• Cinder support for over subscription
• LBaaS V2 Support
• Cinder implementation of new Consistency Group functions
• OVN Hardening
• Enhancements to Swift container sync feature
• Neutron Availability Zone Support including compatibility
• Cinder block storage for Kubernetes pods persistent
with OVN
storage
• Easier performance analysis
Trove • Modular L2 agent
• Back up and restore capabilities to Trove CouchDB and • TOSCA NFV templates parsing and translation to HOT
DB2 guest agent • Kuryr Docker networking plugin
• CouchDB guest agent enhancements including user and
database management capabilities Security
• User metadata support for Secrets
Magnum • Support for multiple Keystone authentication methods in
• Support to enhance networking performance for Castellan
Kubernetes clusters • New admin tool to manage Barbican database and HSM
• Enhancements to user guide and troubleshooting guide Interoperability
Ceilometer • Vendor Registration to link vendors to test data
• Metrics for LBaaS V2 resources Heat
Globalization • Support for LBaaS V2 resources
• Large translation effort for key projects • OpenStackClient support for Heat CLI
© Copyright IBM Corporation 2016. Technical University/Symposia materials 49
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM Contributions: Key Areas around Storage

Storage and Database as a Service Contributions

• In OpenStack’s block storage component (Cinder) IBM made numerous


improvements to the base functionality including removing deprecated oslo-
incubator code, being active testers and developers of the new os-brick library
and helped get improved volume replication support integrated.

• Cinder driver improvements included support for over subscription,


implementation of new Consistency Group functions and implementation of
replication for Cinder backend drivers such as storwize_svc, XIV and DS8k.

• In OpenStack’s object storage service (Swift) IBM contributed enhancements to


the container sync feature.

• In OpenStack’s Database as a Service Component (Trove) IBM added back up


and restore capabilities to both the Trove CouchDB and DB2 guestagents. Also
IBM enhanced the CouchDB guestagent to support user and database
management capabilities and make these available through the OpenStack
dashboard plugin for Trove.

© Copyright IBM Corporation 2016. Technical University/Symposia materials 50


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM System Storage support for OpenStack

IBM Storage products are OpenStack-ready:


– XIV and Spectrum Accelerate
– Storwize family, Spectrum Virtualize and FlashSystem
– DS8000
– IBM Spectrum Scale
– IBM Spectrum Protect
– IBM Spectrum Control

Industry-leading features accessible through


OpenStack
– XIV ease of use
– Easy Tier
– Real Time Compression
– Storage virtualization
Read here
– Storage assisted migration
IBM Storage with OpenStack Brings Simplicity and Robustness to Cloud
by Mark Peters, Senior Analyst and Wayne Pauley, Senior Analyst
Enterprise Strategy Group
Watch the Video
© Copyright IBM Corporation 2016. Technical University/Symposia materials 51
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack Summit 2016: IBM Spectrum Scale in an OpenStack Environment
Redpaper Published.

http://www.redbooks.ibm.com/abstracts/redp5331.html

© Copyright IBM Corporation 2016. Technical University/Symposia materials 52


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
The IBM approach to interoperability in the cloud

Standards-based. Flexible. Customer driven.

HTTP, OpenStack
LinkedData, Open Source
OSLC, Reference
TOSCA

Collaboration across clients, Cloud Computing


providers, vendors & Reference Architecture
developers (CCRA)

IBM’s ecosystem approach to


an Open Cloud Architecture

© Copyright IBM Corporation 2016. Technical University/Symposia materials 53


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack core components
Dashboard
End-user self-service portal and administrative interface
Horizon

Block Storage
Block storage service, create/clone/manage volumes
Cinder
Monitoring / Metering
Extendable statistics and metering service
Ceilometer
Object Storage
Scalable, redundant http-based put/get object store
Swift

Imaging Service
Image registration and (optional) storage
Compute Glance
Provision and manage large networks of virtual machines
Nova
Identity
Unified authentication system, integrates with existing systems
Keystone
Network
Network-connectivity-as-a-service, provision and manage L2
Neutron networks

© Copyright IBM Corporation 2016. Technical University/Symposia materials 54


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
OpenStack higher-level components
Application Catalog
Publish cloud-ready applications in a browsable catalog so that
they are instantly consumable by users Horizon
Murano
Data Processing
DNS Service Hadoop/Spark Map/Reduce cluster provisioning
Scalable, on demand, self service access Sahara
to authoritative DNS services, in technology-agnostic manner
Designate
Database Service
Provides DbaaS provisioning functionality for relational and
Deployment Trove non-relational DB engines
Installing, upgrading and operating
TripleO OpenStack clouds
Key Management Service
Secure storage, provisioning
Containers Service Barbican and management of secrets for encryption services
Make container management tools
Magnum a first-class resource in OpenStack

Message Service
Multi-tenant cloud messaging service
Orchestration Zaqar for web developers.
Combines resources into a running cloud stack
Heat
Bare Metal
Managing and provisioning
File Storage physical machines
File/NAS storage service, provides Ironic
Manila shared file storage to guest VMs

Swift Keystone Nova Cinder Neutron Glance Ceilometer

© Copyright IBM Corporation 2016. Technical University/Symposia materials 55


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
IBM Tucson Executive Briefing Center

Tucson, Arizona is home for


storage hardware and software
design and development

IBM Tucson Executive


Briefing Center offers:
– Technology briefings
– Product demonstrations
– Solution workshops

Take a video tour!


– http://youtu.be/CXrpoCZAazg

© Copyright IBM Corporation 2016. Technical University/Symposia materials 56


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Tony Pearson
9000 S. Rita Road
Bldg 9032 Floor 1
About the Speaker Master Inventor
Tucson, AZ 85744
Senior Software
Engineer
+1 520-799-4309 (Office)
IBM Storage
tpearson@us.ibm.com

Tony Pearson is a Master Inventor and Senior Software Engineer for the IBM Storage product line. Tony joined IBM
Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on
storage topics covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to
Cloud Computing, Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads
client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and
virtualization products.

Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners
every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume
I through V.

Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and
software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in
Electrical Engineering, both from the University of Arizona. Tony holds 19 patents for inventions on storage hardware and
software products.

© Copyright IBM Corporation 2016. Technical University/Symposia materials 57


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Additional Resources from Tony Pearson

Email:
tpearson@us.ibm.com

Twitter:
twitter.com/az990tony

Blog:
ibm.co/Pearson

Books:
www.lulu.com/spotlight/990_tony

IBM Expert Network on Slideshare:


www.slideshare.net/az990tony

Facebook:
www.facebook.com/tony.pearson.16121

Linkedin:
https://www.linkedin.com/in/az990tony
© Copyright IBM Corporation 2016. Technical University/Symposia materials 58
IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Continue growing your IBM skills

ibm.com/training
provides a comprehensive
portfolio of skills and career
accelerators that are
designed to meet all your
training needs.

If you can’t find the training that is right for


you with our Global Training Providers, we
can help.

Contact IBM Training at dpmc@us.ibm.com


Global Skills Initiative

© Copyright IBM Corporation 2016. Technical University/Symposia materials 59


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.
Trademarks and Disclaimers

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other
countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks
of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a
registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open
Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband
Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO
Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind.

The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental
costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not
constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor
announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to
non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or
delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's
current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will
experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the
workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM
representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Changes may be incorporated in production models.

© IBM Corporation 2016. All rights reserved.


References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the
World Wide Web at http://www.ibm.com/legal/copytrade.shtml.

ZSP03490-USEN-00

© Copyright IBM Corporation 2016. Technical University/Symposia materials 60


IBM Systems Technical Events | ibm.com/training/events may not be reproduced in whole or in part without the prior written permission of
IBM.

You might also like