An Integrated Approach To Operational Efficiency & Reliability

An Integrated Approach to Operational
Efficiency & Reliability

Achieving operational excellence at every step of the data center life
cycle, from design through sustained operations.
James Bartone Marina Thiry

Global Technical Committee Member Operations Work Group Chair
Schneider Electric ABB
The Green Grid Forum 2014

Facility Operations Challenge:
• Operational Documentation
– Non-Existent
– Inadequate
– Disorganized/Scattered
– Equipment-specific only
• Sequence of Operations
– Systems info non-existent or HVAC controls only
– Systems interoperability information - None
– No ‘holistic’ picture (addressing entire data center)
The Green Grid Forum 2014 Copyright © 2014, The Green Grid
Change the Industry
– Universal DC industry problem must be addressed:
– Inadequate or inaccurate Facility Operations Documentation results in non-optimized data
center performance due to uncertainty or lack of information
– Process issue
– Lack of operational focus & required documentation during design and construction
– Incompatible data collection formats utilized during design, construction, and
commissioning
– Inadequately specified requirements for operational documents ‘turnover’ at project
completion
– Non-integrated change management system
Recommendation
TGG White Paper #52 - An Integrated Approach to Operational Efficiency &
Reliability provides prescriptive measures for better data collection, integration,
and change management practices throughout the entire facility lifecycle
– Lists and defines required operational documents for turnover to Facility Operations team
– Recommends employing a commissioning consultant from schematic design phase
through ‘Go Live’ turnover
– Presents a formulated approach for producing a holistic facility sequence of operations
manual that is delivered to the Facility Operations team at turnover
– Defines and outlines Sequence of Operations format
Facility Life Cycle & Operational Docs
Sequence of Operations and the Data Center Lifecycle
Planning & Turnover &

Design Construction Commission Operations
Programming Transition
Elec. Coord’n QA/QC QA/QC Procedures

Site Analysis Project Summary O & M Manuals
Study Inspections MOPS, SOPs, EOPs
Environmental Functional Test Vendor Contact Training Materials

Arc Flash Study Shop Drawings
Reports Scripts List (Drills, Classes, etc.)
Owner’s Project CFD Air Flow Integrated Systems Training Records

Submittals Spare Parts List
Requirements Model Test Report & Certification
Issue Resolution As-Built Maintenance
Building Program IFC Drawings Equipment List Drawings
Log History (CMMS)
Change Order Commissioning Control Network Project Impact
Basis of Design Specifications
Log Report Diagrams Analysis
Cx Plan & Ops Update Systems Updated OpDocs
Sequences
Punch List Panel Schedules
Diagrams & SOO
Regulatory Inspection Update Systems Sequence of Ops Change Control
Documents Reports Narrative Manual Log
Cert. of Substantial Software Back-up
Permits
Completion Disks
Certificate of
Occupancy Warranties
Design Phase
• Schematic Design (SD)
–Budget & schedule established
–Systems to be commissioned identified
• Design Development (DD)
–Building architecture and floor plans ‘locked’
–Primary critical infrastructure systems selected
• Construction Documents (CD)
–Construction drawings & specifications
–Operational sequences identified
–Commissioning plan completed
Commissioning (Cx) Plan
• Commissioning Consultant (CxA) prepares:
– Under jurisdiction of Design Integrator
– Draft to be completed by 60% CD review
– Separate Cx Specification section required
• Roadmap for all critical infrastructure testing

– Narrative descriptions/scripts (step-by-step instructions)
– Graphical depictions (order-based, time-sequenced)
• Operations Sequences are defined

– Systems to be commissioned identified
– Equipment functionality and interoperability tested
Construction Phase Issues
• Substitutions and change orders
–Owner accepted for cost savings or other reasons
–Unforeseen conditions, errors, omissions, etc.
–Must be vetted against BOD and Cx Plan
–All related documents must be revised & distributed
• Operational data supplied by contractor

–Equipment info: ID, serial no., location, installation date
–Start-up data, statistics & performance information
–No standard data format (incompatible software tools)
–Information lost or not integrated into project record
Commissioning Process
Five Commissioning Levels
1: Document review
• Cx Script preparation
2: Post construction inspections
• Insures conformance to plans and specifications
3: Start-up equipment
• By contractor using manufacturer’s checklists
4: Functionally test equipment
• By contractor using CxA scripts
5: Integrated Systems Test
• Includes Facilities Ops team (training)
Cx Report and its Uses
•Cx report contents
–Test scripts (step-by-step instructions)
–Test results and data
–Component error log
–Trending reports
–Basis of DCIM assumptions
•Cx report uses

–Benchmarking future data center performance
–Predicting results of unplanned events
–Assessing risk prior to making changes
–Basis of SOO Manual




Log History (CMMS)
Sequences
Diagrams & SOO
Permits
Completion Disks
Certificate of
Sequence of Operations Manual
• Hierarchy
– Facility responding to its ambient environment
– Systems interacting with each other (interoperability)
– System internal sequencing (intra-operability)
– Equipment level detail
• Components
– System Outline – standard format
– Narratives – ‘drill-down’ detail
– Diagrams – logic-based flow charts
– Design phase operational sequences and Cx findings
SOO Systems Outline
•Overview •Cooling Systems
–Site and Building Parameters
–HVAC System
–Power Distribution System
–Cooling Systems –Humidification & Dehumidification
–Mechanical Systems Systems
–Monitoring & Control Systems –Data Center Air Circulation
–Data Infrastructure
–Outside Air & Filtration
•Power Systems –Remainder of Cooling
–Utility Power
–Ventilation
–No-Break Power/Uninterruptable Power Systems
–Short-Break Power/Back-Up Systems
–House Power
SOO Systems Outline Cont’d
• Mechanical Systems • Infrastructure Management
– Fuel System Pumping and Piping Systems (DCIM)
– Storage Tanks – Electrical Power Management
System
– Spill Containment
– Building Management System
– Fire Suppression System – Aspirating Smoke Detection System
– Industrial Water System Pumping – Fire Alarm
and Piping – Fuel System
– Other Utility Piping – Leak Detection
– Access Control and Security
• Data Infrastructure Systems Systems
– Distribution
– Media Types
– Management
Narrative Excerpt
5. UNINTERUPTIBLE POWER SYSTEMS
a. UPS-1
1. Normal Operation:
a. Supplies critical load to CD11
2. Maintenance Operation:
a. Place system into internal bypass. Use MBB-1 to bypass UPS. Open the module
batteries disconnect (MBD) circuit breaker by simultaneously pressing the Battery
Trip and Control Enable pads. Manually open the UPS input circuit breaker by
moving the handle to the OFF position. UPS is isolated for work.
3. Fault Operation:
a. Upon a loss of input power the batteries will discharge to maintain required load.
b. If the unit is unable to maintain required voltage, the system will go to internal
bypass.
b. UPS-2
Flow Chart Diagram Example
BY BY
DATE
DATE
REV.
REV. DESC RIPTION
DESCRIPTION
Flow
ElectricalFlow
SH1 Utility Board Operation
SH1 Utility Board Operation
Chart
Chart
Electrical
M1 Resotred Yes M1 is Open No Tie Breaker is Open Yes
M1 Resotred Yes M1 is Open No Tie Breaker is Open Yes
Yes
No
Yes
No
Stop, No
No Auto Return M2 Restored M2 Failure M1 Failure
Actions
Stop, No
No Auto Return M2 Restored M2 Failure M1 Failure
Actions
Yes
Yes
Stop, No
5 Second Delay Auto Return No 5 Second Delay 5 Second Delay
Actions
Stop, No
5 Second Delay Auto Return No 5 Second Delay 5 Second Delay
Actions
Yes
Yes
Open Tie 5 Second Delay Open M2 Open M1
Contractor:
Architect:
Engineer:
Open Tie 5 Second Delay Open M2 Open M1
Contractor:
Architect:
Engineer:
Close Tie Close Tie
1 Second Delay Open Tie
Breaker Breaker
Close Tie Close Tie
1 Second Delay Open Tie
Breaker Breaker
Close M1 1 Second Delay

Close M1 1 Second Delay Lee
Lee
Technologies
Technologies
Close M2
Close M2
JOB:
ENGR:
JOB:
CHKBY:
ENGR:
FILE: SH1 Flow
CHKBY:
Charts_02-26-
FILE: SH1 Flow
13.vsd
Charts_02-26-
DATE:
13.vsd6/11/2013
DATE: 6/11/2013
Facility Ops Integration Goals
• Optimally performing data center
– Collaborative Systems
– Clearly Defined Operating Parameters
• Clear documentation
– Processes
– Procedures
• Change management system

– Consistent format
– Version Control
• All of the above at “Go Live!”




Log History (CMMS)
Sequences
Diagrams & SOO
Permits
Completion Disks
Certificate of
The Expanding Role of DCIM
 The latest definitions and models of a
DCIM system
 How DCIM helps with integrating data

center operations
 Examples of how DCIM is being used to

better manage cost, capacity and control
throughout the data center life cycle
Q. What is the single most significant
factor that has impacted the evolution of
human brains and DCIM systems?
A. Environmental instability. Constant change.
An Integrated Approach
Your Brain Your DCIM
1. Alerting network 1. Data collection
and normalization
2. Orienting network 2. Visibility and
decision support
3. Executive network 3. Action and/or
automation
Constant Change
 Changing compute workloads that
impact HVAC systems
 Increasing energy costs that
squeeze operating budgets and
curtail resources
 Contaminants that clog and
corrode our systems
 New technologies that require
integration—without which we can’t
continue to evolve
DCIM Definitions and Models
Gartner Research (circa 2011) 451 Research (circa 2014)
Datacenter Service Optimization (DCSO)
Data Center Business Planning
Data Center Service-Based Costing
Data Center Service Management
Data Center Energy Management
Data Center Infrastructure

Management (DCIM)
Cooling Optimization
Data Center Asset Capacity Mgmt
Data Center Monitoring
Core DCIM Platform
enables more AGILITY
Why Use DCIM to Integrate Ops?
Energy Management
Resource Forecasting
& Energy Planning
Power Management
Asset & Capacity
Planning
Remote Monitoring
Maintenance Management
Control and Automation

Data Center Evolution
Facility Management
Troubleshooting, Root Cause
Analysis & Alarm Management
Managing the [3 Cs]
Cost Capacity Control

 How do you better manage IT and facility capacity to lower energy consumption and
avoid penalties from overages?
 When UPS goes on battery, what other devices are impacted? What other parts of the
business are at risk?
 How do you evolve data center operations to ‘the next level’ without compromising
reliability and becoming inefficient or unsustainable?
Example #1: Cost
Power chain Cooling chain
Example #2: Capacity
Challenge
─ Using Visio and Excel
─ Facility data not readily available to IT team for asset mgmt
─ Losing site of implementing strategic data center services
Approach
─ Streamline IT ops using a single, self-maintainable tool
Critical to Success
─ Integration of existing monitoring systems with other IT mgmt
tools, e.g., ticketing systems
─ Facility mgmt must embrace the tool
Results
─ Interactive, real-time tool
─ Balance of resource management between strategic
improvements and efficiency tactics with both IT and Facilities
Example #3: Control
In summary…
Visibility Decision Support Automation
Conclusion
Part 1 – Highlights of TGG white paper #52: Best practices for better data
collection, integration and change management
 Integrated approach to managing change
 Operational documentation
 Sequence of operations
Part 2 – The expanding role of DCIM, from design to sustained operations

 Latest DCIM definition and models
 How DCIM helps with integrating data center operations
 Examples using DCIM for managing cost, capacity and control
Questions?
The Green Grid (TGG)
About The Gree n Grid

The Green Grid is a global consortium of companies, government agencies, and educational institutions
dedicated to advancing energy efficiency in data centers and business computing ecosystems. The Green Grid
does not endorse vendor-specific products or solutions, and instead seeks to provide industry-wide
recommendations on best practices, metrics , and technologies that will improve overall data center energy
efficiencies. Membership is open to organizations and individuals interested in data center operational
efficiency at the Contributor, General, or Associate member level.

An Integrated Approach To Operational Efficiency & Reliability

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

An Integrated Approach To Operational Efficiency & Reliability

Uploaded by

Copyright:

Available Formats

An Integrated Approach to Operational

Efficiency & Reliability

James Bartone Marina Thiry

The Green Grid Forum 2014

Planning & Turnover &

Elec. Coord’n QA/QC QA/QC Procedures

Environmental Functional Test Vendor Contact Training Materials

Owner’s Project CFD Air Flow Integrated Systems Training Records

• Roadmap for all critical infrastructure testing

• Operations Sequences are defined

• Operational data supplied by contractor

•Cx report uses

Planning & Turnover &

Elec. Coord’n QA/QC QA/QC Procedures

Environmental Functional Test Vendor Contact Training Materials

Owner’s Project CFD Air Flow Integrated Systems Training Records

Open Tie 5 Second Delay Open M2 Open M1

Close M1 1 Second Delay

• Change management system

• All of the above at “Go Live!”

Planning & Turnover &

Elec. Coord’n QA/QC QA/QC Procedures

Environmental Functional Test Vendor Contact Training Materials

Owner’s Project CFD Air Flow Integrated Systems Training Records

 How DCIM helps with integrating data

 Examples of how DCIM is being used to

A. Environmental instability. Constant change.

Data Center Infrastructure

enables more AGILITY

Control and Automation

Cost Capacity Control

Visibility Decision Support Automation

Part 2 – The expanding role of DCIM, from design to sustained operations

About The Gree n Grid

You might also like