You are on page 1of 19

GUIDE ON

ACHIEVING
RELIABILITY
THROUGH
THE DESIGN
PROCESS

This document describes good engineering practice, which embeds the


key factors and, if followed, should ensure that customers’ expectations
are met when it comes to operational performance.

Improving the world through engineering


CONTENTS SCOPE

Scope 3 This guide offers guidance on how to design and make a reliable
Foreword 4 product (e.g. equipment, system or service). It aims to provide everyone
Introduction to Reliability in Design Principles 5 associated with designing, manufacturing, operating or maintaining
Reliability in Design as a Business Goal 6 products with:
Designing for Reliability 7
Risk Management 9 • Best practice for a cross-industry approach to reliability
Measuring Organisational Reliability Capability 11 • A capability maturity model (CMM) that will allow an organisation
Competence and Training 13 to assess its (and its suppliers’) level of maturity in reliability
Application of Principles for Ensuring Reliability Capability 14 engineering practices
The Key Processes 15
Bibliography 31
The reliability engineering discipline is examined, including definitions,
Appendices 32
explaining the interrelationships of activities and their importance,
Definitions 33
generally and at specific times during development, manufacturing,
IMechE Position Statement on Safety and Reliability 34

installation, operational and maintenance phases of a products life cycle.


The guide includes advice on the methods of assessing the overall level of
capability of the organisation, along with references to example standards
and publications, which offer additional guidance upon the subject.

2 Guide on achieving Reliability through the design process www.imeche.org 3


INTRODUCTION TO
RELIABILITY IN
DESIGN PRINCIPLES
FOREWORD

Customers want products that work and go on This guide describes good reliability engineering Reliability is a defining characteristic of a product’s It is important to consider reliability at all stages
working for a ‘reasonable’ period of time. If the practice, which embeds these four factors and, if performance and life cycle costs. In the context of of the product life cycle. Reliability characteristics
customer’s expectations are not met they may followed, should ensure that expectations are met. this guide, it is understood that reliability is the should be included as an explicit design
regard the equipment or service as ‘unreliable’. It provides an aide-mémoire to all personnel with ability of an item to perform a required function requirement, as consideration at the early stages
Dissatisfaction through poor reliability is likely to experience in managing reliability, and a primer of under stated conditions, including environment of design contributes most significantly to the
lead to lost business, which would then be difficult the essentials of what to expect for those who have and usage, for a stated time. success or failure of the final product. It becomes
to recover. In today’s highly competitive markets no, or limited, experience. increasingly difficult and costly to influence the
it is therefore worth recognising that it is not The aims of the reliability engineering discipline, as reliability of a product once the detail design
‘reliability’ that sells a product, but the benefits Guidance is given as to formal techniques which part of an integrated team, are to: stage has been reached. For maximum benefit,
of having a reliable product. Benefits of good can establish and maintain confidence that the efforts should start as early in a product’s life cycle
• Specify and agree a product’s reliability
reliability include the need to keep fewer spares, product will perform as designed when required as possible, noting that empirically the 1:10:100
requirements
carry out fewer inspections, reduced maintenance, to, and for as long as necessary. Management rule applies (i.e. at each life cycle stage, the cost
increased availability, more marketable products, commitment to these techniques is vital, as is • Manage the focussed activities throughout the of change increases by an order of magnitude).
lower operating costs and ultimately increased knowledge of the circumstances in which they design of a product that will give confidence It is prudent at this stage to recognise that the
profitability. Factors that have the greatest influence should be applied. that reliability requirements can be met reliability of a product cannot be enhanced by
on reliability are: • Co ordinate and monitor the reliability maintenance, only preserved.
influencing activities within the supply chain
Design – ensuring a product is fit for purpose, Designing for reliability requires:
relative to the required use and operating • Contribute to defining through-life activities for
the product to preserve inherent reliability • Commitment and discipline from management,
environment
the team and the individual
• Risk management – assess, analyse and manage
Manufacture – ensuring a product is made risks using techniques, e.g. failure mode and • An overall integrated approach to the design
to as consistent a standard as appropriate to effects analysis, which either result in: process
economically meet customer requirements • Development, measurement and interpretation
- Acceptance, if risks are found to be tolerable
of requirements
Installation / Integration – assimilating the - Mitigation, actions to eliminate the problem,
product with all other associated products and the reduce the probability of occurrence or minimise • Methods for assurance of achieving reliability
environment the consequences upon occurrence requirements

• Monitor in service performance to ensure that • Appropriate management of risk (including


Operation – ensuring adequate consideration is lessons learned from past experience)
reliability requirements are being achieved,
given to usability and foreseeable misuse
while cost of ownership is not adversely affected • Development of appropriate engineering
Maintenance – the measures required to sustain • Integrate through life cycle learning into design, solutions
the operation of the product which must be manufacturing, installation, maintenance and
achievable in an economic, safe operating processes
and timely manner • Consider decommissioning and disposal

4 Guide on achieving Reliability through the design process www.imeche.org 5


RELIABILITY IN DESIGN AS
A BUSINESS GOAL
High-level organisational goals are defined by standard such as ISO 9001. It must be recognised overall business goals. Certification to ISO 55001 Now bringing the topic back to designing for
business needs, regulatory and corporate standards, that such certification does not necessarily assure a may not necessarily be seen to be mandatory for reliability. If we recognise that reliability needs to
customer and ethical requirements. These core goals quality product, but demonstrates that a system is in such organisations, but the practices and ideas be seen as a business goal, and a framework exists
usually incorporate a combination of the following: place. held therein are looked upon as a recognised good that can be used for the achievement of such a goal,
• Health and safety practice as a basis for organisational processes and then attention naturally turns to how we deliver.
The format of the three standards so far mentioned systems.
• Environment
– 9001, 14001 and 45001 – have all been harmonised
• Quality under the ISO directives’ annex SL, which dictates
• Economic factors a common format for ISO management standards.
This intent of this harmonisation is to remove much
Reliable products support all of these business
goals. Health and safety is supported as reliable
of the organisational burden in having a requirement DESIGNING FOR RELIABILITY
to comply with many different standards which
products need fewer unplanned interventions, do previously help disparate and sometimes conflicting
not fail catastrophically or in an unintended manner. requirements. The reason for the lengthy discussion The specific issue facing companies is how to First the organisation needs to set performance
Such failures may also lead to releases of harmful or on this topic is to draw the reader’s attention to achieve the combined goals of: targets. This is where opinions can diverge, as
hazardous substances to the environment. Products the fact that these principles, setting a policy and operations people will often make statements such
that are reliable are more likely to meet customer developing procedures in order to achieve a business This is not an easy task. While most project teams as “it just needs to work” and designers may make
requirements, hence quality is safeguarded; likewise, goal, are very much aligned with the intent of this can deliver a system to cost and schedule, only the statements like “why wouldn’t it work, so long as you
when reliability parameters are well understood and document. best will be able to achieve all three. don’t go outside of the window of design”.
form the basis for engineering then product cost can
be optimised as are through life costs. Compensation A relative newcomer to the ISO management
payments and rework costs may also be reduced standards, ISO 55001 was developed with the intent
through the same principles. of driving sound asset management practices
through implementation of an organisational
Why, therefore, is it usual to find that organisations management system. Unlike the previously
have detailed policies and procedures for health, mentioned standards, however, certification to ISO Affordable Delivered to
safety, environment and quality processes but not 55001 is not widely seen as a requirement for doing Price COST DELIVERY Schedule
necessarily for reliability? It can be proposed that business. Many organisations that rely on public
health, safety and environment are enshrined in funding or whose finances are government regulated
regulations therefore such policies and procedures (e.g. utilities and transport) have been set targets by
are mandatory. Certification to the ISO standards government in the UK to achieve certification. There
45001 and 14001 allow companies to demonstrate is some movement from investor organisations such
compliance with requirements for managing as venture capitalists who recognise that having a
occupational health and safety and environmental system in place for stewardship of capital assets, i.e.
stewardship respectively. their investment, is actually a good idea. RELIABILITY

The requirement for a quality policy and subordinate Asset management is becoming a boardroom topic,
procedures is semi-mandatory as for many and as such a recognition of the fact that taking a
businesses a pre-requisite many customers demand, longer term life cycle cost approach as opposed to Achieving Required
certainly for business-to-business transactions, a shorter term focus on minimising (as opposed to Performance
is certification to a recognised quality assurance optimising) capital expenditure will help to meet

6 Guide on achieving Reliability through the design process www.imeche.org 7


RISK MANAGEMENT

If we return back to our definition of reliability, • Material changes due to global legislation, Here we mention another ISO management of organisational reliability engineering practices.
neither of these statements are time-bound and the e.g. standard, ISO 31000. This standard presents a The core reason for risk management is to uncover
likelihood that something will just work is rather 1. Lead-free solder – joint integrity framework that organisations can use to help potential problems as early as possible and present
absurd. The measurement of reliability can, to manage risk. Do not expect to find organisations the facts in a somehow weighted manner to allow
2. Plating materials (e.g. cadmium no longer
some, be a little abstract as it can involve statistical certified to this standard however, as it is not quality decision making at the right time. Such
allowed)
distributions – suffice to say, at this juncture, that a “certifiable standard”. The principles may be decisions will involve developing mitigating actions,
someone who has a good understanding of how used to audit your own, or other, organisations’ including appropriate contingency planning.
• Emergent technology developments
reliability can be measured and how that relates to
1. Industrial ‘internet of things’ – connectivity, practices for risk management. ISO 31010 presents
the real world should be engaged in helping to define
data collection requirements an overview, and the applicability of, various risk A best practice to be considered is the introduction
targets and the measurement system.
2. Shrinking device architectures management techniques and as such is an excellent of a central risk register at a reasonably early point
primer for individuals who are starting on a journey in product development. This register collects all
Back to the point our fictitious designer made, the 3. Obsolescence
next basic step is defining the window of design. as a risk management practitioner. It is unlikely that of the project and product risks identified through
There are numerous factors to be considered • Serviceability one individual will become an expert in all of the other discrete risk management techniques,
in achieving reliability, some of which could be risk management techniques. providing a master list which in turn can be used
1. Susceptibility to no fault found (NFF) events
inadequately taken into account during design or to drive action, decision or acceptance. This can be
2. Location The reason for the introduction of this standard is considered a list of ‘lessons learnt’ for subsequent
emerge during the life cycle. The life cycle must
be considered to be ‘cradle to grave’, therefore 3. Training and technical skill levels that robust risk management forms the bulk work projects, storing and preserving organisational
both manufacture and dismantling/disposal of 4. Information and documentation
the equipment must be given as much thought 5. Modular design
as operation and maintenance. These influencing
factors include, but are not limited to: • Other issues of note
1. Manufacturing techniques and ‘built-in latent
• Environmental conditions
defects’
1. Temperature – range and cycles
2. Counterfeit components
2. Pressures
3. Owner/operators remote from designer/
3. Humidity manufacturer
4. Arduousness of duty 4. Warranty periods
5. Altitude/Submersed depth
6. Dusts, mists and other environmental Best endeavours should be made during product
contaminants specification to identify all of the aspects that make
up the window of design, to ensure that adequate
• Effects of age and use design considerations are made that will allow the
product to meet expectations, i.e. achieve the set
1. Deterioration of electrical cable insulation
reliability target.
2. Wear
3. Corrosion
4. Fatigue
5. Misuse

8 Guide on achieving Reliability through the design process www.imeche.org 9


MEASURING ORGANISATIONAL
RELIABILITY CAPABILITY
knowledge. Likewise, incorporation of lessons of risk against each other to allow prioritisation Reliability over the long term can be measured are awarded to those organisations investing effort,
learned from within the particular industry or of effort. Organisations may employ a unified by observing the actual reliability performance of and adapting to information flows, at the level of
from the use of similar products can present risk assessment matrix example see Figure 1, to products in the field. In the short term, however, process and organisational preparedness. The five
opportunities to prevent unwanted consequences. ensure a consistent and reasoned approach to risk observation of an organisation’s systems and levels are defined as follows.
management. As with the development of reliability processes related to reliability provides a valuable
Risks of all types should be subjected to screening measurement, this can be an abstract system to indicator of the capability/likelihood of producing
for credibility in this master list, as the techniques relate to the real world therefore individuals with the a reliable product. A capability maturity model LEVEL 1: INITIAL
used to define and (as far as is possible) measure understanding and experience of risk management (CMM), is a useful tool to assess the reliability
risks will undoubtedly do so in different ways. This should be involved in its development. capability of manufacturers. The characteristics At this level the organisational approach to reliability
presents a difficulty in assessing different types which define the reliability capability of an is reactive and ad hoc. There is no consistency in
organisation can be described as: equipment reliability, no formal reliability processes
and no knowledge of reliability performance.
Consequence Level 1: Initial - no risk response
Reliability International Co.
Safety Cost Level 2: Repeatable - immediate risk response
Level 3: Defined - risk response on product
LEVEL 2: REPEATABLE
Result in a major Result in major
safety incident financial losses development
5 Low Medium High Very High Very High This level is achieved when the manufacturing
affecting more leading to loss Level 4: Managed - risk response for product organisation has quality processes in place and is
than one person of jobs and processes capable of generating a repeatable consistency,
Level 5: Optimised - risk response for product, but without any knowledge of equipment reliability
Result in a Result in
major safety major financial 4 Low Medium Medium High Very High processes and organisation and no specific processes to improve reliability
incident losses performance or reduce risk. The response to risk and
Research into the application of the CMM suggests failure is essentially open loop. Education, training,
Result in that reliability capability will be highly dependent and research and design (R&D) are not focused
Result in a
moderate on the degree to which the organisation invests on reliability management or equipment reliability
moderate safety
financial
3 Low Low Medium Medium High
incident effort in organisational learning and knowledge improvements.
losses
management. This in turn depends on a company’s

Result in a Result in
strategy for achieving its performance goals. LEVEL 3: DEFINED
minor safety minor financial 2 Negligible Low Low Medium Medium
incident losses Management attention can focus on different The level 3 organisation is defined and measured. It
aspects of its business. In general, these can be has key procedures and practices in place to define
grouped into the following broad perspectives: reliability such as:
No concern No concern 1 Negligible Negligible Low Low Low • Manufacture of product • The setting of reliability requirements
• Processes (necessary for manufacturing) • The performance of risk and reliability analysis in
• Preparedness to perform processes design
Once in Once in Greater
Once in Once • Reporting, tracking and analysis of reliability data
Probability a thousand a hundred than once
ten years per year
years or less years per year Knowing this provides a basis for making
judgements on the reliability capability of an However, at this level the processes for the
Risk Assessment Matrix 1 2 3 4 5
organisation. The most capable and sustainable management of risk and reliability improvement
organisations will be those adopting a balanced are limited to immediate project issues. There is
Figure 1 approach, investing effort at all steps through a some learning by individuals exposed to failures and
product’s life cycle. The highest levels of capability performance information, but it is not fully organised

10 Guide on achieving Reliability through the design process www.imeche.org 11


knowledge. There is a little feedback to equipment LEVEL 5: OPTIMISED
design, but the response is largely reactive and
limited to equipment on current projects. The mode The organisation has procedures in place to optimise
of organisational learning is, therefore, characterised risk and reliability.
as reactive, single-loop learning. The approach to
risk is via a phased audit and review process with At this level, additional processes are in place for:
quantification at component failure level. Education,
• Feedback and organisational learning
training and R&D processes are limited to those
needed to support immediate project issues. • Verification, validation and benchmarking

Reliability is well defined. Programs are in place to


LEVEL 4: MANAGED sustain long-term continuous reliability improvement
and risk reduction. The learning mode is double
At level 4, organisations should have procedures in and triple loop in that actions are taken, not only to
place to manage reliability. These should include all adapt equipment but also to adapt the organisation
processes and practices listed in level 3, but they and inform education and training to bring about
should be performed to a higher standard and used to reliability improvements. Level 2, 3 and 4 processes
inform other processes. A level 4 organisation should are also in place at this level but operated to a higher
have a capability to perform: standard. The approach to risk is concurrent risk COMPETENCE AND TRAINING
management, whereby risks are identified and
• Formal reliability demonstration to customers
assessed by team members at the point of design In today’s world, it is important that persons are • Understanding the equipment and manufacturing
• Reliability improvement continuously and as a normal part of the design deemed to be ‘competent’. A general definition of processes, and their interactions, in order to
• Project risk management process. All design team members are highly skilled ‘competent’ is “able to do something successfully or appreciate how through-life issues may effect safe
• Supply chain management and knowledgeable about risk and reliability, and efficiently”. More specifically, for UK engineers, this and prosperous operation
organisational goals, policies and procedures are means:
• Management of change and life cycle transitions
updated to ensure that learning is embedded. • Develop an appreciation of engineering processes Incorporated and chartered engineers, in accordance
• Reliability testing
and practices that would be regarded in the with UK Engineering Council criteria, may
appropriate industry as sound engineering demonstrate engineering competence. There needs
At level 4, reliability is well defined and analytical
practice to be a recognition of discipline, industry or product
tools are more disciplined than at level 3. The
specific competence. Therefore, a high reliability
learning mode is still single loop; actions are taken • Appreciation and practical application of
organisation will have a training and competence
to correct identified faults in the equipment families, judgements made on tolerability of risk in terms of
framework that incorporates sound understanding
but there is little or no effort to adapt organisational reliability
of reliability engineering principles, not only for
processes to bring about reliability improvements. • An appreciation of the tools and processes engineers but for individuals working at all levels of
The approach to risk is essentially phased risk available for the assessment and management of the organisation.
management. Formal analysis is used to inform risk risk
reduction and reliability improvement strategy. There • Understanding of the aspects of reliability that
is a very disciplined approach to reliability analysis, are required during the design, manufacture,
involving specialist tools for systems reliability and fabrication and construction programmes
availability analysis. Education, training and R&D are
• Understanding of the aspects of reliability that
aimed at equipment improvement, but not targeted
are required during operation and maintenance
on processes.
activities

12 Guide on achieving Reliability through the design process www.imeche.org 13


APPLICATION OF PRINCIPLES FOR THE KEY PROCESSES
ENSURING RELIABILITY IN DESIGN
In order to define the activities to ensure reliability is “built in” during design, let us first consider a basic A company’s maturity with regards to practices regarding reliability in design can be separated into three
design process (see Figure 2). Recognising the varied approaches that can be taken, and the iterative distinct categories, with corresponding key processes (KPs):
nature of design, this may be either overly simplified or complicated, but it is useful to consider such a 1. Formal risk analysis and demonstration of reliability
model to define the “reliability enablers” at each stage.
2. Implementation of reliability achievement and improvement strategy
3. Longer-term investments in reliability management

1. Define 5. Engineering Or, more simply, ‘planning’, ‘doing’, and ‘sustaining’. These key processes are summarised in table 1, and
9. Testing 13. First build
requirements specification described in detail in the subsequent sections.

Maturity characteristic KP Key processes

2. Refine 10. Evaluation, 1 Setting and allocating reliability requirements


requirements, set 6. Initial design redesign and 14. Field trials Formal risk
analysis and 2 Assurance of reliability in design
parameters further testing
assurance of 3 Process verification, validation and benchmarking
reliability
4 Reliability and risk analysis in design
11. 5 Reliability and risk reduction in design
3. Generate
7. Modelling Manufacturability 15. Handover
concepts 6 Project risk management
review
Implementation 7 Reliability testing
of reliability
achievement and 8 Failure reporting, analysis and corrective action system
improvement
4. Concept 16. Post-handover strategy 9 Supply chain management
8. Prototyping 12. Final design
appraisal reviews 10 Management of change and life cycle transitions
11 Management of transition from development to production
Figure 2 12 Feedback and organisational learning
Longer-term
investments in
13 Education and training in reliability
reliability
However, it must also be recognised that the design process must fit into the overall organisational management 14 Research and development in reliability
management system and therefore it is useful to think of activities or organisational aspects – ‘key
processes’ – and how they influence the design for reliability process.
Table 1 - Maturity characteristics and associated key processes

The implementation of reliability through design centres on the deployment of core engineering design
principles supported by the factors determined during the planning phase. This section focuses on key
processes that, when deployed in support of design activities, can help achieve the required reliability level.

14 Guide on achieving Reliability through the design process www.imeche.org 15


KP1

SETTING AND ALLOCATING RELIABILITY


REQUIREMENTS
Customers set system-level requirements and expect The reliability goals should form a key element of the
suppliers and design contractors (system integrators) system requirement document and include:
to be capable of interpreting and allocating reliability
• Probability of system failure at a given life
requirements to system components and subsystems
as an input to design. However, projects can vary • System availability at different stages throughout
from a simple device or machine to a complex the life cycle, split by probability of failure and
process plant, the failure characteristics of which expected downtime for restorative maintenance
can be vastly different. It is an inherent fact that • Expected operating environment and stresses
simple machine systems are more reliable than • Operational usage
complex ones. The maturity of suppliers and design • Technical and maintenance support
contractors in their ability to interpret and meet
• Acceptance criteria
reliability requirements will also vary, and some
attention needs to be given to how this is managed • Definition of failure
throughout the design cycle. • Total life cycle costs (or expectation that this is to
be developed)
The first step in any design and development
project is to consider if the required reliability goals Each requirement will be specified by a target
are realistic and achievable given the intent and value to a given level of confidence, or some other
complexity of the system, and the maturity of the measurable performance characteristic.
design and manufacturing supply chain.

Typical activities

Purchaser Supplier

1. Define operational requirements 1. Provide supplier R&M organisational


structure

2. Set system-level requirements 2. Define the R&M philosophy

3. Define the reliability and maintainability 3. Advise relevant legislation


(R&M) policy/strategy

4. Define high-level R&M goals and link 4. Assist in R&M strategy and plans
these to the business risks

Related basic design stages: define requirements, refine requirements and set parameters, generate
concepts, concept appraisal, engineering specification, evaluation, re-design and further testing.

16 Guide on achieving Reliability through the design process www.imeche.org 17


KP2 KP3

ASSURANCE OF RELIABILITY PROCESS VERIFICATION, VALIDATION


IN DESIGN AND BENCHMARKING
It is suggested that provision of relevant assurances 1. The purchaser’s reliability requirements shall Suppliers with the highest levels of capability There may be greater confidence in the validity of
that the required reliability can be met is best be determined and understood by both the will have standard processes for the verification, this key process if carried out by an independent
achieved by means of a reliability & maintainability purchaser and supplier validation and benchmarking of reliability design body, and some industry sectors legally require
(R&M) case. Based on the principle of a safety 2. A programme of activities shall be planned and tasks, namely to: ‘third-party’ certification, e.g. aerospace.
case the R&M case (e.g. in accordance with BS implemented to deliver the requirements, with
EN 62741) should contain an overview of the regard to mitigating risks identified during • Check that all design assumptions, reliability
design philosophy used and justification of the analysis models, collected supporting data and system
design and manufacturing processes relevant to stresses are valid
3. Demonstration via documented progressive
the achievement of the R&M requirements. At the • Verify that all required processes and activities
assurance that the requirements are being, have
beginning of a project, it should provide confidence, have been carried out
been or will be met
before committing significant resources, that
• Benchmark the capability of the organisation to
there is minimal risk of failing to meet the R&M
Progress reports will give a summary of evidence perform key processes
requirements. During the design, development and
to support programme milestones. They should
manufacturing processes, the R&M case will be a
provide sufficient detail to allow a decision on
living document and proceed through a number of Typical activities
whether to proceed from one phase of the project to
stages of increasing detail. During in-service use, it
the next.
should provide confidence that the system remains
Purchaser Supplier
reliable and maintainable in its operational role. In
Acceptable evidence of achievement of the R&M
summary, it will form an audit trail and a dossier of 1. Agree acceptability of plans and results expected 1. Define methods and plans for demonstration
case will include calculations, results of tests,
all evidence supporting the claim that the reliability
simulations, trials, demonstration, analysis, plus
requirements have been met. The R&M case 2. Review and agree interpretation of progress 2. Report on progress and any problems
interpretation of any relevant historical evidence
presents reasoned, auditable arguments to support
from like systems, or even expert opinion or best
the contention that a defined system satisfies (or will
practice. 3. Determine any third-party verification 3. Work with third parties as required
satisfy) reliability requirements. It requires a strategy requirements
and will contain evidence based on three objectives:

4. Review subsequent plans 4. Revise plans if required


Typical activities
5. Update risk register 5. Produce case reports
Purchaser Supplier

1. Develop R&M case 1. Define and plan a strategy to demonstrate


achievement of R&M case Related basic design stages: concept appraisal, evaluation, re-design and further testing, handover,
post-handover reviews.
2. Review supplier progress and output 2. Manage progress against plan

3. Review/revise strategy in response to 3. Produce R&M case reports


deviations from expectations

4. Produce R&M case reports

Related basic design stages: refine requirements and set parameters, generate concepts, concept
appraisal, engineering specification, initial design, modelling, prototyping, testing, evaluation, re-design
and further testing, manufacturability review, final design.

18 Guide on achieving Reliability through the design process www.imeche.org 19


KP4 KP5

RELIABILITY AND RISK ANALYSIS RELIABILITY RISK REDUCTION


IN DESIGN IN DESIGN
System designers and suppliers will be expected to should be capable of identifying and assessing: Where outputs from analyses or tests indicate that strength distributions – finite element analysis
possess a high level of competence in their ability to: reliability is unacceptable, actions must be taken to (FEA)
• Susceptibility to forms of damage/failure improve. The efforts expended to improve reliability 5. Increase tolerance to corrosion, fatigue, erosion
• Model the system and interfaces (e.g. reliability • Tolerance to predicted damage/failure need to be proportionate to the consequential and wear damage
block diagram) risks of failure, bearing in mind ethical and legal 6. Select components or materials less susceptible
• Human factors in manufacture, installation,
• Identify potential system failure modes and commitments. There are a number of strategies that to damaging factors
operation or maintenance
mechanisms and assess probability and can be adopted in design to enhance reliability, and 7. Control the environment
consequences of occurrence (failure mode and • Common cause and common mode failures these can be broken down into the following three
effects analysis, FMEA) • Single-point failures broad categories: • Actions to increase reliability at the system level,
• Simulation of the system, e.g. Monte Carlo e.g.:
A risk register with reasons, assumptions and • Actions to increase inherent reliability at
analysis, Weibull, fault tree analysis 1. Active redundancy
mitigation proposals should be created to identify equipment level, e.g.:
2. Passive redundancy
These will be applied during the design process and and control risks. This usually forms part of the 1. Change technology or item to remove a failure
will be used to inform where reliability improvements FMEA and would include reasons for, and benefits of, mode
• Actions to increase maintainability e.g.:
are required at component or system level. The particular mitigating actions. An evidence framework 2. Remove or reduce faults introduced during
can then be produced to show how requirements manufacturing and assembly (process FMEA) 1. Predictive technologies
process should also follow the principle of ‘designing
for manufacture’ to simplify both assembly and have been or are being achieved to be included in 3. Perform highly accelerated stress screening 2. Reduce time to repair and replace
subsequent maintenance of equipment. Analyses the R&M case. (HASS) to eliminate early life failure inducing
defects Thought must be given to changes made to the
4. Reduce or adequately separate design design, and it may be necessary to revisit KPs
Typical activities and operational stresses such as thermal, 1-4 after mitigating actions or redesigns are
mechanical, chemical, etc. Consider stress/ undertaken.
Purchaser Supplier

1. Conduct or commission analyses 1. Interpret requirements and prepare strategy Typical activities
to deliver
Purchaser Supplier
2. Review supplier outputs 2. Establish an R&M programme
1. Assessment of analyses results 1. Suggest potential opportunities for improvement
in design
3. Revise strategy 3. Produce case reports

2. Development of mitigating actions 2. Advise plans for controlling and minimising risk
4. Review case reports 4. Participation in analyses
during design and development

5. Update risk register 5. Update risk register


3. Agree acceptance criteria for the R&M case 3. Update risk register

Related basic design stages: concept appraisal, engineering specification, initial design, modelling, 4. Update risk register
prototyping, testing, evaluation, re-design and further testing, manufacturability review.
Related basic design stages: concept appraisal, initial design, modelling, prototyping, testing, evaluation,
re-design and further testing, manufacturability review, final design, first build, field trials.

20 Guide on achieving Reliability through the design process www.imeche.org 21


KP6 KP7

PROJECT RISK MANAGEMENT RELIABILITY TESTING

The majority of equipment is developed, In the context of a reliability management capability, The purpose of reliability testing is to explore and characteristic life. The data set can be analysed
manufactured, assembled and installed within a project risk management activities will typically validate performance characteristics and failure according to the Weibull, Duane or Crow-AMSAA
project environment. Project goals are generally involve: processes. This is quite distinct from qualification procedures. These techniques are covered in
focused on the delivery of equipment within a testing, where the goal is to confirm that a specified various sources, and the results of the analysis will
• Identification of project tasks
specified time and to a set budget. These goals performance requirement can be met. Reliability enable the ability to meet the reliability goals to be
can be in conflict with the goal of developing • Identification of resources required to testing is carried out to reveal weaknesses, which assessed.
reliable equipment due to the increased cost from successfully achieve the task goal are then corrected, and has several goals:
commissioning studies or purchasing higher • Identification of threats to the successful Reliability testing can also include a number of
• Verification of failure modes (or lack of) identified
specification equipment or materials. execution of each task (e.g. lead time to highly specialised methods, for example accelerated
in FMEA activities
purchase, availability of labour or resources, cost life testing (ALT), highly accelerated life testing
Project risk management provides some assurance pressures from material price fluctuations) • Identification of unpredicted physical failure (HALT), reliability environmental testing (RET),
that equipment reliability will not be compromised modes reliability growth trials (RGT), test automation
• Identification of consequences of each threat (e.g.
in order to meet project goals, or as a minimum catastrophic failure, increased equipment cost) • Model and simulation validation framework (TAF), step stress testing (SST).
where compromises are made the effects of such • Determining the probability of each consequence • Learning about physical failure mechanisms
compromises are understood. Suppliers will be occurring (qualitative or quantitative) where the mechanism is poorly understood Halt and similar techniques must be properly
required to demonstrate a strong project risk • Demonstrating reliability improvements from considered and designed to avoid introducing or
• Assessment of overall risk and underlying risk
management capability to ensure that equipment design changes causing additional non-representative problems,
drivers
reliability as well as project requirements are which can disguise the real issues. Expert advice
• Creation of a risk register to aid control and • Generation of reliability and equipment life data
achieved. from experienced test personnel should be sought.
mitigation
Due to cost and practicality, reliability testing is
• Periodic review to ensure that actions taken are A robust FRACAS (see KP 8) is an essential and
usually conducted with a small sample population
mitigating risk integral part of this activity.
and a limited testing period. Even with limited
results, it is still possible to estimate failure
Typical activities characteristics such as infant mortality, ageing and

Purchaser Supplier
Typical activities
1. Review areas of potential risk based on past 1. Review and advise areas of potential risk,
experiences e.g. new techniques or components
Purchaser Supplier

2. Determine supply chain risk management 2. Update risk register 1. Specify testing requirement 1. Propose testing methods
protocols
2. Validate results 2. Analyse results
3. Document process in a risk management
procedure 3. Agree corrective actions 3. Propose corrective actions

4. Create risk register


Related basic design stages: modelling, prototyping, testing, evaluation, redesign and further testing,
first build, field trials.
Related basic design stages: define requirements, refine requirements and set parameters, generate
concepts, concept appraisal, engineering specification, initial design, modelling, prototyping, testing,
evaluation, re-design and further testing, manufacturability review, final design, first build, field trials,
handover, post-handover reviews.

22 Guide on achieving Reliability through the design process www.imeche.org 23


KP8 KP9

FAILURE REPORTING, ANALYSIS AND SUPPLY CHAIN MANAGEMENT


CORRECTIVE ACTION SYSTEM
Failure tracking, reporting and analysis is the making critical equipment reliable. However, good It is often found that high-level system failures with Integration and compatibility must be checked at
sensing arm of a closed-loop circuit, which enables data is difficult to define. It needs to be relevant significant consequences originate from the failure of each stage of the supply chain to ensure that no
the organisation to implement organisational to the particular concern, e.g. reliability, collected minor components in the system. Systems designers/ undesirable influences occur between components or
learning and improve reliability. When combined over a period and sorted out from non-relevant data. integrators must understand the significance of subsystems. They must also be compatible with the
with corrective action, it is also known as FRACAS Some thought and energy should be expended the risk potential of all components, including intended operational environment.
or DRACAS. Failure tracking and reporting must up front to determine what type of data will be minor components supplied by second and third-
involve communication between the customer and collected, how it will be collected, where it will be tier suppliers. Reliability requirements should be The organisation responsible for final build should
the suppliers. These difficulties can be reduced stored, how it will be structured, who is going to use allocated, where appropriate, down to all components understand his responsibility for considering the
by the establishment of a failure analysis team it, and for what purpose. (i.e. piece-part level) including commercial off the system as a whole, not just its constituent parts.
involving both customer and equipment supplier, shelf (COTS) and bought-in items. All suppliers will
and modern communication and shared computing There are some industry specific published be expected to be capable of managing the various
technology is very conducive to such a collaborative standards such as ISO 14224 for oil & gas and interfaces between the customers and suppliers
approach. petrochemical assets and KKS RDS-PP for power throughout the supply chain, including recognition of
generation, which offer a taxonomy for structuring likely obsolescence issues.
Good data regarding operational performance is such data. The ORDEA handbook is an example of
essential evidence to assess reliability, as is a good an industry publication, following the structured
system to capture and use it for improvement. principles of ISO 14224, containing failure modes Typical activities
Turning data into useful information is the key to and data.
Purchaser Supplier

Typical activities 1. Define desired methods and plans for support 1. Confirm understanding of requirements
requirements
Purchaser Supplier
2. Review and agree proposals 2. Ensure design and development plans will meet
1. Agree proposed methods of monitoring and 1. Define methods and techniques to be adopted compliance requirements
control

3. Report on progress and impact of any


2. Monitor performance 2. Report on progress and any problems problems

3. Review corrective actions 3. Produce analyses of results and any recovery 4. Revise plans if required
plans if required

5. Produce case reports


4. Update risk register 4. Produce case reports

Related basic design stages: define requirements, refine requirements and set parameters, generate
Related basic design stages: testing, evaluation, re-design and further testing, first build, field trials,
post-handover reviews. concepts, concept appraisal, engineering specification, initial design, modelling, prototyping, testing,
evaluation, re-design and further testing, manufacturability review, final design, first build, field trials,
handover, post-handover reviews.

1 FRACAS: failure reporting, analysis and corrective action system; DRACAS: defect reporting, analysis and corrective action system.

24 Guide on achieving Reliability through the design process www.imeche.org 25


KP10 KP11

MANAGEMENT OF CHANGE AND MANAGEMENT OF TRANSITION FROM


LIFE CYCLE TRANSITIONS DEVELOPMENT TO PRODUCTION
Many failures originate from changes made during The system should be applied throughout the whole Due to the differences between development and Key aspects to be considered include:
the life cycle of the equipment or occur at life cycle equipment life cycle: production facilities, the transition phase between 1. Demonstration of manufacturing and assembly
transitions. Such changes may affect factors such • Conceptual design the two can reveal unforeseen problems, unless techniques
as performance, compatibility or manufacturing manufacturing techniques and procedures have been
• Detail design 2. Proving of production-standard tooling and
procedures. Companies will be expected to given due regard during the design process. Various
• Manufacture associated equipment
develop change control processes which include engineering procedures routinely used to overcome
procedures for: • Assembly problems during development, are often difficult or 3. confirmation of test methods
• Shipping even not possible in the production environment. 4. Confirmation of associated instructions and
• Monitoring - identification of change
At this stage it is too late and thus expensive and publications
• Assessing risks from the change • Installation
time-consuming to implement changes. This causes 5. quality control procedures
• Managing the effects of change - change control • Operation
frustration; from increased costs and risk of reduced
follow-up and risk reduction • Disposal reliability compared to that anticipated. No design scheme should be issued as finalised
• Monitoring and benchmarking changes and unless it has been accepted by manufacturing.
follow-up actions Actual cycles will vary with each industry but there Wherever possible all development manufacture and Similarly, reliability concerns should be addressed
will be specific stages, which all need to be managed certainly final production standard prototypes (where and vetted as providing at least the minimum
and recorded. applicable/possible) should be manufactured using requirements before any scheme is released to the
(and proving) production standard tooling and next stage.
techniques.
Typical activities
Nb: production engineering and manufacturing
should be involved as early as possible in the design
Purchaser Supplier
and development process.
1. Ascertain procedures for identification and 1. Advise or devise procedures for configuration and
control of changes required during the equipment control of changes during the equipment life cycle
life cycle Typical activities

2. Monitor associated risk aspects and configuration 2. Advise methods for advising where owners when Purchaser Supplier
control procedures changes affect component interchangeability
1. Develop, or manage development of, build 1. Design for manufacture/maintenance
procedures and quality control plans
3. Review implications for training and 3. Advise implications for training and
documentation documentation, etc.
2. Monitor progress to confirm capability of 2. Early involvement of production engineering
manufacturer

Related basic design stages: define requirements, refine requirements and set parameters, generate
3. Accept standard of manufactured items 3. Implement appropriate systems and
concepts, concept appraisal, engineering specification, initial design, modelling, prototyping, testing,
procedures to ensure smooth transition
evaluation, re-design and further testing, manufacturability review, final design, first build, field trials,
handover, post-handover reviews.

Related basic design stages: concept appraisal, engineering specification, initial design, modelling,
prototyping, testing, evaluation, re-design and further testing, manufacturability review, final design,
first build.

26 Guide on achieving Reliability through the design process www.imeche.org 27


KP12 KP13

FEEDBACK AND ORGANISATIONAL EDUCATION AND TRAINING


LEARNING IN RELIABILITY
The tracking and analysis of data has limited intellectual capital of the organisation. Intellectual Reliability improvement will require in-depth management to enable design teams to understand
value unless the information is converted into capital takes three main forms: knowledge of how design and the design the meaning of reliability, how it is affected by
organisational knowledge and ultimately used • Human capital – knowledge of individuals in the processes can prevent failure. Training should be design and to become familiar and proficient with
to improve equipment reliability. Good reliability organisation targeted both at understanding technical failure the tools.
management will provide resources to ensure that • Structural capital – knowledge structured in mechanisms, and at how organisational and human
information is fed back to the whole organisation policies, procedures, databases and knowledge factors lead to errors and mistakes in design of
involved in design and system integration, to bases components and systems. Technical training will
understand the lessons to be learned from failure. • Customer capital – knowledge of the value to also be needed in reliability engineering and risk
customers
Organisational learning is concerned with the
transformation of data and information into the Typical activities

Purchaser Supplier
Typical activities
1. Identify the necessary reliability related skills for 1. Develop and deliver appropriate training for staff
Purchaser Supplier the type of organisation

1. Organise regular progress review sessions to 1. Advise procedures for monitoring and analysis
2. Develop and deliver appropriate training for
analyse and understand progress of accumulating data and results
project staff and advisers

2. Assist as appropriate with any resulting revisions 2. Advise methodologies for feedback of information
required to the programme produced into the programme Related basic design stages: define requirements, refine requirements and set parameters, generate
concepts, concept appraisal, engineering specification, initial design, modelling, prototyping, testing,
3. Update systems and documents with learning as 3. Produce reports accordingly evaluation, re-design and further testing, manufacturability review, final design, first build, field trials,
it arises handover, post-handover reviews.

Related basic design stages: initial design, modelling, prototyping, testing, evaluation, re-design and
further testing, manufacturability review, final design, first build, field trials, handover, post-handover
reviews.

28 Guide on achieving Reliability through the design process www.imeche.org 29


KP14

RESEARCH AND DEVELOPMENT


IN RELIABILITY
Organisations with high reliability capabilities will also requires an efficient and comprehensive data
include R&D programmes to support and inform the management and usage system in order to maintain
reliability strategy of the organisation. and gain maximum advantage of information
from records of usage and relevant experiences.
Research and development programmes will be
Appropriate historical information is of great
dictated by the company’s overall business strategy.
benefit when reviewing designs or developing new
However, the most capable organisations will
equipment.
use research and development as a key input to
both equipment and process development. This

Typical activities

Purchaser Supplier

1. Develop, introduce and monitor programmes 1. Discuss relevant previous performance of similar
to record equipment operational performance equipment and advise information which would
and identify particular effects, e.g. frequency be useful
and environment

2. Inform the company R&D strategy according to 2. Research other sources of useful information
where value from reliability improvement can and debate with purchaser
be gained

Related basic design stages: modelling, prototyping, testing, evaluation, re-design and further testing,
manufacturability review, final design, first build, field trials, post-handover reviews.

30 Guide on achieving Reliability through the design process www.imeche.org 31


BIBLIOGRAPHY APPENDICES

NB: this bibliography is just a selection of the many Wong, W.; 2002, How did it Happen? Engineering DEFINITIONS However, for this guide, we accept and work with
books and publications available on the subject, and Safety and Reliability, PEP. ISBN 1860583598 the following definitions:
should not be regarded as definitive. Definitions of reliability
Of the above publications, Carter is out of print but Safety is the visible and demonstrable absence of
Andrews, J. D. and Moss, T. R.; 2002, Reliability and new or used copies are available from, or via Amazon There are numerous and various accepted unacceptable risk of undesirable events affecting
Risk Assessment, Wiley-Blackwell. online store. Cost is generally around £60-£100 each. definitions of reliability. For example, ISO 8402 the health and safety of the workforce and the
ISBN 1860582907 quality vocabulary defines reliability as “the ability public at large (HSE definition).
to perform a stated function under stated conditions
Carter, A.; 1986, Mechanical Reliability (2nd edition), Restricted availability (i.e. not on the ISBN for a stated period of time”. Reliability is the ability of an item to perform a
Macmillan Education. ISBN 0333405870 system) – UK source: required function under stated conditions, including
Reliability is an operational parameter; simply, environment and usage, and for a stated time.
Carter, A.; 1997 Mechanical Reliability and Design, Reliability: a Practitioner’s Guide, Intellect/Relex it is sustained performance. The achievement
Wiley-Blackwell. ISBN 0470237198 Software Corporation, 2003. of reliability results, in the first instance, from a Maintainability is the ability of an item, under
structured, coherent and knowledgeable approach stated conditions of use, to be retained in, or
Davidson, J.; 1994, The Reliability of Mechanical British Standard 5760. Part 0.R Reliability of Systems, to the initial derivation of the level of reliability restored to, a state in which it can perform its
Systems (2nd edition); IMechE Guides for the Process Equipment and Components. Introductory Guide to demanded by the operational requirement. required functions, when maintenance is performed
Industry, Wiley-Blackwell. ISBN 0852988818. Reliability. BSI, 1986; R reissued in 2014. Subsequently, the design and development under stated conditions and using prescribed
of the equipment to meet that need must be procedures and resources.
Hecht, H.; 2003, Systems Reliability & Failure underpinned by a contract strategy that delivers
Prevention, Artech House. ISBN 1580533728 Restricted availability (i.e. not on the ISBN and demonstrates that the requirement has been Availability is the ability of an item (under
system) – US source: satisfied. combined aspects of its reliability, maintainability
Kleyner, A. and O’Connor, P. D. T; 2012, Practical and maintenance support) to perform its required
Reliability Engineering (5th edition), RIAC (reliability information analysis centre) has a Successful performance is an absence of undesired function at a stated instant of time or over a stated
Wiley-Blackwell. ISBN 047097981x. very good range of publications effects. Although reliability failures can be time.
at reasonable prices. measured, the absence of data does not prove that
Moubray, J.; 1999, Reliability Centred Maintenance, the system has achieved its aims. As previously Dependability is the collective term used to
Butterworth-Heinemann. ISBN 0750633581 Reliability toolkit: Commercial Practices Edition stated, when new projects are initiated, there is a describe the availability performance and its
System Reliability Toolkit large number of design, functional and operability influencing factors: reliability performance,
O’Connor, P. D. T.; 2002, Practical Reliability Maintainability Toolkit requirements set by the customer and imposed on maintainability performance and maintenance
Engineering (4th edition), Wiley-Blackwell. Supportability Toolkit the project contractors and system suppliers. So support performance.
ISBN 0470844639 Quality Toolkit how will companies interpret reliability? It is the
Mechanical Applications in Reliability Engineering function of the design and engineering teams to Generally, these and other aspects, referred to
Smith, D. J.; 2011, Reliability, Maintainability & Risk, Applied Reliability Engineering (Vols I and II) provide an engineering solution which best meets collectively as reliability, are core aspects of risk
Butterworth-Heinemann. ISBN 008096902x FRACAS Application Guidelines the technical requirements without compromising management in engineering.
the core business values identified above.
Thompson, G.; 1999, Improving Maintainability and
Reliability Through Design, Wiley-Blackwell. ISBN
1860581358

32 Guide on achieving Reliability through the design process www.imeche.org 33


IMECHE POSITION
STATEMENT
ON SAFETY AND
RELIABILITY
Government has encouraged engineering
institutions and academia to promote the
achievement of safety and reliability. A In order to facilitate the advancement
statement has been prepared to present the of the science of mechanical
Institution of Mechanical Engineers’ current engineering by preserving the respect
views on safety and reliability issues. in which the community holds persons
who are engaged in the profession of
For the purposes of the statement, the mechanical engineering, every member
following have been agreed: shall, for as long as they continue to be
a member, comply with by-laws 29 to 31
Safety is the visible and demonstrable and the code of conduct regulations. All
absence of unacceptable risk of undesirable members are ambassadors
events affecting the health and safety of the of the institution and must therefore
workforce and the public at large. conduct themselves in a manner that
upholds and enhances the reputations
Reliability is the ability of an item to of the institution, the profession of
perform a required function under stated mechanical engineering and the
conditions, including environment and institution’s members. All members
usage, and for a stated time. shall conduct their professional work
and relationships with integrity
Generally, these and other aspects, such and objectivity and with due regard
as maintainability and availability, referred for the welfare of the people, the
to collectively as ‘safety and reliability’, organisations and the environment
are considered to be core aspects of risk with which they interact. All members
management in engineering. shall take reasonable steps to maintain
appropriate professional competences.
In addition to this, practitioners of safety
and reliability activities are expected to
follow a code of conduct, such as that
defined by IMechE:

34 Guide on achieving Reliability through the design process


Institution of
Mechanical Engineers

1 Birdcage Walk
Westminster
London SW1H 9JJ

imeche.org
Issue 3 - March 2019

You might also like