Professional Documents
Culture Documents
THE BUSINESS OF
TRANSFORMATION
ACCELERATING INNOVATION
THROUGH CULTURAL CHANGE
TAY HONG HUEI
"Innovation distinguishes between a leader and a follower."
- Steve Jobs
4 Introduction
44 Conclusion
4
The digital age permeates all industries without bias and reframes our
beliefs in time-honoured business principles. Organisations that fail to “After all, the first prototype
embrace technology and innovation are handicapped at best, and risk
facing demise should they remain intransigent. of a digital camera was
Kodak, Nokia, and Yahoo are a few clear examples of industry leaders
who were disrupted by innovation and consequently declined rapidly
created in 1975 by Steve
behind their competitors.
Sasson, an engineer working
for … Kodak.” 1
1
Kodak’s Downfall Wasn’t About Technology,
Harvard Business Review
5
their industry. They frequently From improving the way a business engages its customers
to increasing workforce effectiveness, digitisation enables
divert sufficient resources businesses to reinvent themselves as they discover new and
radical ways of acquiring customers while adding incremental
to participate in emerging value.
opens up.” 2
2
Kodak’s Downfall Wasn’t About Technology,
Harvard Business Review
6
BUILDING
HIGH-PERFORMING TEAMS
“High-performing IT organisations experience 60X fewer failures and Analysis further revealed that teams that have the ability to
recover from failure 168X faster than their lower-performing peers. develop and deliver quickly, are also better at:4
They also deploy 30X more frequently with 200X shorter lead times.”3
Innovating, designing, Reacting to conditions
To stay ahead of the competition, businesses will need to establish
and creating value faster when necessary:
50% x2.555
scalable teams designed with agility, velocity, and innovation
capabilities - common traits displayed in teams that embrace DevOps
practices.
High-performing teams are characterised by their ability to deliver and faster lead time to deploy;
x2.604
maintain a high degree of software performance. time spent.
3
State of DevOps Report
Puppet Labs, IT Revolution 2015
4
Accelerate: State of DevOps, Strategies for a New Economy
DORA 2018
demands 1.53x
more likely.
9
KEY CHARACTERISTICS
ASPECT OF
SOFTWARE DELIVERY
PERFORMANCE
ELITE HIGH MEDIUM LOW
Fast and stable
DEPLOYMENT
FREQUENCY
On-demand
(multiple deploys
per day)
Between
once per
hour and
Between once
per week
and once per
Between
once per
week and
software release
once per day month once per
month For 5 consecutive years, high-performance teams categorised
under the Elite group were observed to consistently excel in four
LEAD TIME FOR Less than one Between one Between one Between one
CHANGES hour day and one day and one month and measures under two aspects of software delivery performance:
week month six months Throughput and Stability.
TIME TO RESTORE SERVICE Less than one Less than one Less than one Between one ‘Deployment frequency’ and ‘Lead time for changes’ represent
hour day day week and one Throughput, while ‘Time to restore service’ and ‘Change failure
month rate’ both represent Stability.
7
Accelerate: State of DevOps, Strategies for a New Economy
DORA 2018
11
HIGH-PERFORMANCE TEAMS:
IMPACT ON INNOVATION TIME SPENT ELITE HIGH MEDIUM LOW
UNPLANNED WORK
50%
19.5%
50%
20%
40%
20%
30%
20%
AND REWORK
VS REMEDIATING
SECURITY ISSUES
5% 5% 5% 10%
Reactive unplanned
WORKING ON DEFECTS 10% 10% 10% 20%
IDENTIFIED BY END USERS
Both elite and high performers see teams spending 50% of The obvious goal is to shift people who are cemented in unproductive
their time doing new work: designing, innovating, and creating work to something more beneficial and meaningful.
value. On the other hand, low performers spend more time on
customer support work and defects, which are considered low
value and unproductive interruptions, essentially struggling to
get things done.
12
8
Accelerate: State of DevOps, Strategies for a New Economy
DORA 2018
The most dangerous phrase in language is:
“We have always done it this way.”
14
CHALLENGES TO SOFTWARE
DELIVERY
Long software release cycle
A common but misguided approach observed in the industry is the practice Categorised as misguided performers, these teams primarily
of long release cycles.9 The frequent argument posed here is that additional suffer from the inability to recover quickly from failed or
time can be given to test and ensure quality between releases. degraded services. Interestingly, the ‘change failure rate’ is
even higher than medium performers. It is more beneficial
to develop in short, iterative cycles.
all ERP projects fail to meet their DEPLOYMENT FREQUENCY Between once per month
and once every six months
objectives.” 10
LEAD TIME FOR CHANGES Between one month and six months
9
Accelerate: State of DevOps, Strategies for a New Economy Accelerate: State of DevOps, Strategies for a New Economy
DORA 2018 DORA 2018
Your Guide to a Successful ERP Journey
10
Deloitte
15
This is compounded when large changesets are introduced with System Outage
each release. Not only does it make troubleshooting a pain, Unavailability; Economic
cascading failures throughout the system make recovery an implications
extremely long and tedious process.
DEVOPS: BEYOND
CONTINUOUS DELIVERIES
Originating from the desire to improve collaboration between Unfortunately, this motivation is lost to some adopters, who
Development and Operations, DevOps (hence the name) is simply view DevOps as using a certain set of tools.12
fundamentally a transitive concept designed to accelerate
software delivery through collaboration, and concurrently
keep quality and security intact. “Using Puppet or Docker or
Neither the concept of automation nor the frustrations of siloed Jenkins or other tools does not
mentality are new. This stretches way back before Patrick Debois
started championing for change in 2009, after experiencing mean you are “doing DevOps.”
the “wall” between these two traditionally opposing units. At
the time, he was inspired by an O’Reilly Velocity conference The tools are not DevOps, they
presentation: 10+ Deploys Per Day: Dev and Ops Cooperation at
Flickr. merely enable it.”13
To have fully shared responsibilities between Development and Some are even confused and cannot distinguish between
Operations, and eliminate “hand overs, no longer my concern” DevOps, Continuous Integration, and Continuous Delivery
mentalities between units along the value chain, DevOps (CI/CD). While CI/CD is definitely a key practice, the scope of
encourages nothing but everyone’s end-to-end commitment. DevOps is larger than that.14
DevOps.com
DevOps and Continuous Delivery: Not the Same
13, 14
DevOps.com
18
100 10%
75
50 0%
In 2017 In 2018
25
FULL DEVOPS ADOPTION RATE
Extent of DevOps adoption by software developers worldwide in 2017 and 2018
Statista
1 JAN 2004 1 AUG 2008 1 MAR 2013 1 OCT 2017
PROMINENT PRACTITIONERS
2016 IEEE/ACM 38th IEEE International Conference on Software Engineering McKinsey Digital
Companion 22
JAX Award Winners Announced at JAX 2015 Conference
The Story of Apollo - Amazon’s Deployment Engine, Werner Vogels CTO
18, 19
Jaxenter
Amazon.com
The Netflix Simian Army
23
5 reasons your DevOps initiative could fail, and how to avoid them
24 27.4% Disagree
Gartner
23
DevOps.com
26
Evolution and Processes: A Qualitative Study of DevOps Usage in Practice
Journal of Software
24
ADOPTION PITFALLS
Non-linear transformation
Automation helps low Automation increases test DevOps transformation is an enlightening experience, as it serves as
performers progress requirements, which are a learning journey for organisations to root out dated mindsets and
to medium performers dealt with manually. A
mountain of technical debt misguided practices in software delivery. The initial stages, however, are
blocks progress often filled with challenges and uncertainties.
A typical J-curve of transformation illustrates the experience and various
Technical debt and
increased complexity
stages an organisation goes through during adoption.27 A few quick wins
cause additional manual at the beginning will throttle a euphoric experience, as teams begin to
controls and layers see tangible progress as automation is put in place and silo breakdowns
of process around
changes, slowing work open up the possibility of closer collaboration.
DORA 2017
25
Automation without
refining processes
Automation is a core practice in DevOps and it focuses on optimising
flow instead of individual processes. This involves evaluating your
team’s practices and procedures.
When layers of tools are clumsily put together and automation is
simply forced upon existing processes that do not make sense,
it results in a bundle of systems that are neither streamlined nor
efficient, and makes collaboration worse.
TRANSFORMATION MEANS
CONTINUOUS IMPROVEMENTS
ORGANISATIONS HAVE A SYSTEMATIC AND Combined with the right environment, organisations can accelerate
transformation rapidly. DevOps encourages people to iteratively try
CONSTRUCTIVE WAY TO DEAL WITH MISTAKES new ways to improve their current system. Experimentation is risky and
AND TO LEARN FROM IT. that means mistakes are bound to happen, but they can also be turned
into valuable lessons. A safe culture means providing the bedrock for
31.8%Neutral positive change to happen.
Organisations with low tolerance towards mistakes or do not have a
constructive method to deal with them often struggle with change and
18.1% Yes innovation.
The pillars of
transformation
To change an organisation from one that is only concerned
with its bottom line into one that is respected for its
innovation, thought leadership, and ability to disrupt the
industry, it is important to establish a strong foundation in
culture and mindset. To achieve excellence, the principles
must first proliferate across all levels of the organisation.
This change fundamentally encompasses the people,
technology, and practices within the business, forming the
basis of our DevOps Transformation Framework.
30
1 2 3
Framework lays out the foundation that An ecosystem of automated self- The organisation establishes a safe culture
aims to nurture a growth mindset and service systems facilitate workflows, for transformation to flourish. Teams are
solidify the understanding of DevOps and encourage the use and sharing guided by a long term vision advocating
principles and practices. of tools to promote collaboration. creativity and self-driven initiatives.
ESTABLISH A COE TO
SUSTAIN MOMENTUM Structured vs
Anti Patterns
1 1
The establishment of a Centre of Excellence (COE) is a Advocates DevOps Advocates
common practice to catalyse change in an organisation. It practices and DevOps, but has
serves as an important entity to facilitate change through provide metrics for no metrics to
leadership, best practices, research, and training in an success criteria measure success
area of interest.31
3 3
Shares equal Behaves as
responsibility separate entity
with teams on the pursuing
success of DevOps independent
Establishing a Center of Excellence to Scale and Sustain Open Innovation,
31
Key recommendations
2
Create awareness and provide leadership to
To sustain transformation, a dedicated, transparent, support the movement or initiatives
proactive, and consistent champion is needed. Our
research highlights the most important goals to consider
when designing a DevOps COE:
1. Pragmatic alternatives
2. How to achieve them
3. Immediate and long term benefits of adopting change
Be Ready For Internal Equip Worforce With The Right Be Mindful When Using Cloud
Resistance Skills
1. Be specific and precise on vision 1. COE needs to work in tandem with 1. Use Cloud as an extension or
and roadmap HR to identify relevant and necessary overflow from an already existing data
2. Provide literature review to cite skills sets centre
success in the industries and conduct 2. HR needs to identify talent 2. Hybrid setup gives the benefits of
benchmarks against them strategies and training plans to running your own data centre and the
3. Collaborate with business functions upgrade existing workforce to foster flexibility to use on-demand resources
to advocate value proposition innovation to cope with abrupt or unanticipated
3. HR could find and recruit new pressure
4. Provide workshops and trainings to
establish common understanding talents
Focus on Flow, Not Individual Coach More, Restrict Less Deliver Quickly But On
Processes Confidence
1. Your workflow is as fast as its 1. Focus on doing things "the right 1. Continuous delivery without
slowest point way". Remove security theater and accurate means to measure quality
2. Fighting the symptoms of slowness blind policing increases business risks
by increasing manpower resources 2. Setup a learning campus to instill a 2. Bring forward test planning and
may not necessarily help culture of continuous learning strategies
3. Where workflows cannot be 3. Promote awareness to best
automated, they must be equipped practices through trainings and
to notify, escalate and supply precise workshops
information to hasten the recovery 4. Use routine surveys to help
process perceive the efficiency of organisation
workflows
37
A COE should:
Employees express fear of
1. Be specific and precise on vision and roadmap change when we introduce
digital transformation
2. Provide literature review to cite success in various industries
initiatives
and conduct benchmarks against them
To achieve this:
1. A COE needs to work in tandem with HR to identify relevant
and necessary skill sets
2. HR needs to identify talent strategies and training plans to
upgrade existing workforce
3. HR could find and recruit new talents
39
DevOps workflow focuses on speed and quality. This leads to an A better approach would be to use Cloud as an extension or
increase in demand for infrastructure efficiency and availability overflow from an already existing data centre. A hybrid setup
at a lower cost, primarily as a result of automation and testing. allows the use of additional Cloud resources as and when only
The reactionary, knee-jerk course of action to this upsurge is for necessary.
organisations to start migrating everything into Cloud.
Continuous delivery without accurate means to measure quality This underscores the urgency to focus and invest in automated
increases business risks, while casting doubt and sundering testing, as it is crucial to continuous delivery. Test planning and
confidence at the same time. strategies should be brought forward and be involved during
the early stages of software development. Underestimating test
“Given that most firms, even the ones following continuous infrastructure capacities can also cause poor executions and
testing best practices, admit that their software testing processes congestions that often erode both the speed and quality of your
have risk gaps and do not always give accurate measures deliverables.
of business risk, it stands to reason that the 80% who say
they always or often deliver within acceptable risk may be
overestimating their capabilities.”32
32
The Definitive Software Quality Metrics For Agile + DevOps
Forrester Research
41
DevOps is built on the foundation of trust, continuous learning, We experienced a familiar practice where a long list of approvers
and collaboration. The purpose of a COE is to deliver with was mandatory for even the most common and routine
excellence and to unify silos under an equal banner. requests. Despite having this in place, requests were blindly
approved and justifications were not properly validated. It was
However, workflows that are too restrictive can upset the neither foolproof nor effective, and did little but elongate a
improvement of system flow. While certain security measures process.
are put in place for good reason, some restrictions simply act
as security theatre - defined as “the practice of investing in
countermeasures intended to provide the feeling of improved
security while doing little or nothing to achieve it.”33 Blind policing is inefficient and instead, people should be
coached to do things the “correct way.”
Security Theater
33
Wikipedia
42
FOCUS ON FLOW,
NOT INDIVIDUAL PROCESSES
Your workflow is as fast as its slowest point. In addition, an often neglected practice in the industry is the
lack of automated recovery systems, where automation is
Although some bottlenecks are caused by a limit in capacity, not designed to deliver only one-way - from code to production
all teams experience the same issue. Fighting the symptoms of environments. But when problems occur, teams fall back on to
sluggishness by increasing manpower resources should not be manual intervention and slow recovery activities, thereby causing
the blanket solution. blockers that may cascade to other workflows.
Improving flow requires time and effort, as well as analysing, In reality, not all workflows can be fully automated. But when
planning, and simplifying processes. Using pre-emptive it is absolutely necessary to mediate the situation manually,
measures to establish a flow that grants some form of control processes must be equipped with the ability to:
can also be beneficial. These measures are not necessarily
technical in nature, and can be methodological, such as Agile/ 1. Quickly notify or activate relevant support teams
Lean Management or the practice of Scrum/Kanban in teams.
2. Escalate workflows that are blocked to maintain progress
Long cycles Re-work, customer Siloed units Individual and Bottlenecks and Climate of fear
(3-6 months) support (+20%) disconnected dependencies when making
processes mistakes
Short cycles (on- Re-work, customer Fully shared Optimised overall Automated Safe culture,
demand - weekly) support (<15%) responsibilities flow and self-service systematic learning
Innovate, design systems
and create value
(30%-50%)
44
PALO IT’s team of DevOps consultants Our end-to-end approach takes the
can help organisations to assess best out of Design Thinking, Agile,
their maturity of practice, identify and DevOps to help clients disrupt
implementation gaps, and provide their industries, reduce their time-to-
expertise to align transformation goals market, and successfully run their digital
and accelerate adoption rate. transformations.
THE AUTHOR
HONG HUEI TAY
DevOps and Cloud Lead
Hong Huei has over 15 years of diverse experience across enterprise systems, Cloud & container architectures, IoT tech., mobile
platforms, AR/VR applications and gaming. He considers himself a software generalist and is convinced DevOps should be a part of
every organisation's playbook. He is also a co-author of multiple ACM and IEEE publications.
EDITED BY DESIGNED BY
MOSES XIAO GREGOIRE BONNIN
Content Strategist Marketing & Design
Specialist
SPECIAL THANKS
DIMITRI BAIKRICH CHRIS CHAN JELINE LIM
CTO Creative Lead Design Lead