Professional Documents
Culture Documents
net/publication/228556143
CITATIONS READS
57 7,247
3 authors, including:
Sarah Sheard
Carnegie Mellon University
78 PUBLICATIONS 1,028 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Sarah Sheard on 29 October 2017.
Electronic Industries Alliance (EIA)2 working group SE-CMM. Meanwhile, in December 1993, a group
composed of representatives from the Aircraft Industry spun off from the INCOSE SECAM working group.
Association, Department of Defense, National Security This group included eight organizations who agreed to
Industries Association, EIA, Institute of Electrical and provide full-time authors for a systems engineering
Electronics Engineers (IEEE), and INCOSE released capability maturity model [SE-CMM 1995] to be re-
in December 1994 a “commercialized” version of MIL- leased in one year’s time.
STD-499B as EIA Interim Standard (IS) 632, [EIA/IS This group, later called EPIC (for Enterprise Proc-
632 1994]. This was done with the understanding that ess Improvement Collaboration), used the Software
considerably more industry input would go into a re- Engineering Institute (SEI) of Carnegie Mellon Uni-
placement version, to be called EIA 632. In parallel, versity for project management and administrative
the IEEE also released in February 1995 a commercial support. Thus, EPIC products were released as SEI
“Trial-Use” standard IEEE 1220-1994 [IEEE 1220- documents. Version 1.0 of the SE-CMM was released
1994 1995]. IEEE 1220-1994 states that it will be in December 1994, and an associated appraisal method
merged with EIA/IS 632 into a single American Na- was released in March 1995. Version 1.1 of both were
tional Standards Institute (ANSI) standard on systems released in February and June 1996, respectively.
engineering to be jointly published by the EIA, IEEE, Unfortunately, this meant there were now two
and INCOSE.3 systems engineering models on the market. On the one
hand, the SE-CMM had the SEI’s Software CMM
EIA 632 and ISO 15288. A ballot version of the new
[SW-CMM 1993] legacy in its favor. Other organiza-
EIA 632 was made available to reviewers in August
tions took an opposite approach: some INCOSE mem-
1997. Comments were submitted, and the EIA Techni-
bers believed that anyone with a first name of “Soft-
cal Committee is expected to complete the work on the
ware” should not be speaking for systems engineering.
revision with the expectation of a summer 1998 publi-
To say there was disagreement in the field is an under-
cation. One of the intents of the revision is to use EIA
statement.
632 as an early U.S. implementation of processes for
engineering a system that are expected to be covered in SECM (EIA/IS 731). INCOSE’s Corporate Advisory
the evolving ISO standard 15288. [Martin 1998a] and Board, and the Director for Systems Engineering in
[Martin 1998b] describe the new standard and how it OSD, agreed that the two models had to come together.
has evolved from the interim standard. EPIC and INCOSE agreed to work toward a merged
The ISO standard for system life cycle processes, model, eventually called the Systems Engineering Ca-
ISO 152884, is being coordinated by the same interna- pability Model, and given the number EIA/IS 731,
tional committee that created the software life cycle since the EIA sponsored and facilitated the merger
processes standard, ISO 12207. Working Draft #2 was effort. Monthly meetings took place over a period of
released for national body review in January 1998. A years, and the initial review copy of the SECM was
first committee draft is anticipated as early as October distributed at the 1997 INCOSE symposium.
1998 with publication of the International Standard as There is considerable overlap among the models’
early as December 1999. contents, so the technical merging of the two models
turned out to be considerably easier than determining
SECAM. INCOSE sponsored a working group that
sponsorship, requirements, and the best architecture.
began in 1992 to address the assessment of systems
In 1998, a new initiative was undertaken by a new
engineering capability. This Capability Assessment
organization formed by the Director of Systems Engi-
Working Group (CAWG) delivered several incre-
neering in OSD. The group formed of industry and
mental products. The most recent Version 1.5 of the
government representatives is looking at the common
Systems Engineering Capability Assessment Model
aspects of all the capability models, including Inte-
[SECAM 1996] was released in July of 1996. Several
grated Product Development, Software, and Systems
large corporations have found this model helpful in
Engineering. The outcome of this group’s effort will
improving their systems engineering work.
have an impact on current models.
SIMILARITIES AND DIFFERENCES
2
The EIA and the Institute of Electrical and Electronics The following sections address first, what are the
Engineers (IEEE ) are two bodies approved to set stan- similarities and differences between standards and ca-
dards by the United States’ official standards-setting body,
pability models in general, then, what are the similari-
the American National Standards Institute (ANSI).
3
See Table 1 for a discussion of the outcome of this.
ties and differences among the five systems engineer-
4
Officially, ISO/IEC 15288.
593
ing standards and then, the three systems engineering speaking is a customer (an acquisition life cycle), a
capability models. contractor (a development life cycle), or even a user (a
maintenance life cycle) [Lake 1997].
Standard vs. Capability Model. Standards and Capa-
Given these variations, it is probably a good thing
bility models both describe good systems engineering,
that the capability models are meant to be used with
but do so somewhat differently. While standards must
any life cycle. However, it is probably also a good thing
go through a defined industry-approval process, in
that standards define the life cycles they are assuming.
order to meet a nation’s guidelines, such as those es-
Otherwise, the “things to do” are without a context.
tablished by ANSI, capability models can be created by
anyone with the resources. Other comparisons are Number of Elements. Most standards have fewer than
shown below. ten process elements, but the systems engineering ca-
pability models have 18 or 19. MIL-STD-499B and
What, not How. Both standards and capability models
(EIA/IS 632) show four interrelated process steps, in-
say what should be done, but try not to say how to do
cluding Requirements Analysis, Functional Analysis,
it. However, some interpret a “what” as a “how.” Often
and Synthesis, all tied to System Analysis and Control
it is a matter of perspective. Recent standards and ca-
(Balance). This last step includes processes such as
pability models have both attempted to avoid the prob-
trade studies, interface and risk management, and
lem by focusing on processes and their related activi-
configuration and data management.
ties and tasks or requirements (the “whats”), not on
IEEE 1220 separates Analysis, which is tied to all
methods and tools (the “hows”).
other process steps, from Control, which it considers to
Purpose. Capability models provide a way to evaluate be one of the process steps. EIA 632 (see Figure 2,
an enterprise’s or project’s systems engineering capa- from the January 1998 version) discusses not one
bility. They provide a multi-point scale, in each of “Systems Engineering Process,” but thirteen processes,
these cases containing six levels, showing a road map in five interrelated groupings: Acquisition and Supply
along which an organization’s process improvement (two processes), Technical Management (three proc-
effort can progress. esses), System Design (two processes), Product Reali-
U.S. military standards originally supported con- zation (two processes), and Technical Support (four
tracts, to aid the government in delivery of quality processes). These processes are intended to be imple-
products or to ensure utilization of consistent processes mented by a single developer during any phase of a
by contractors. In general, commercial standards are system’s life cycle, as applicable.
not imposed on contracts. In the case of commercial Technical Management
Requirements
Request
Implementation
Products
retically are also voluntary, though certainly with the Supply
System
Definition Process
Process Process
SW-CMM it is evident that the practices called out by Acquisition
Solution Transition
Definition To Use
a capability model have been imposed. U.S. govern- Process Process Process
Table 1. Comparison of Process, Focus, and Key Focus Areas in the Three SE Capability Models
SE-CMM (PAs) SECM(EIA/IS 731) (FAs) SECAM (KFAs)
Engineering, Technical, or Systems Engineering Areas
PA06 Understand Customer Needs and 1.1 Define Stakeholder and System 3.1 System Concept Definition
Expectations Level Requirements
PA02 Derive and Allocate Requirements 1.2 Define Technical Requirements 3.2 Requirements and Functional
Analysis
PA03 Evolve System Architecture 1.3 Define Solution 3.3 System Design
PA01 Analyze Candidate Solutions 1.4 Assess and Select 3.4 Integrated Engineering Analysis
PA05 Integrate System 1.5 Integrate System 3.5 System Integration
PA07 Verify and Validate System 1.6 Verify System 3.6 System Verification
1.7 Validate System 3.7 System Validation
PA04 Integrate Disciplines (see 2.3 below) (see 1.4 below)
Project or Management Areas
PA12 Plan Technical Effort 2.1 Plan and Organize 1.1 Planning
PA11 Monitor and Control Technical 2.2 Monitor and Control 1.2 Tracking and Oversight
Effort
(PA04 above) 2.3 Integrate Disciplines 1.4 Intergroup Coordination
(PA18 below) 2.4 Coordinate with Suppliers 1.3 Subcontract Management
PA10 Manage Risk 2.5 Manage Risk 1.7 Risk Management
(none) 2.6 Manage Data 1.8 Data Management
PA09 Manage Configurations 2.7 Manage Configurations 1.5 Configuration Management
PA08 Ensure Quality 2.8 Ensure Quality 1.6 Quality Management
Organization or Environment Areas
PA13 Define Organization’s SE Proc- 3.1 Define and Improve the Systems 2.1 Process Management and Im-
ess Engineering Process provement
PA14 Improve Organization’s SE Proc-
ess
PA17 Provide Ongoing Knowledge and 3.2 Manage Competency 2.2 Competency Development
Skills
PA15 Manage Product Line Evolution 3.3 Manage Technology 2.3 Technology Management
PA16 Manage Systems Engineering 3.4 Manage Systems Engineering Sup- 2.4 Environment and Tool Support
Support Environment port Environment
PA18 Coordinate With Suppliers (see 2.4 above) (see 1.3 above)
uses EIA 632. ISO 15288 is likely to take the same considered all process area content (in that case, called
approach as its software predecessor ISO/IEC 12207, base practices) to be necessary to reach Level 1,
where the focus is on a set of generic processes applied whereas the other two limited what was needed for
as appropriate to accomplish the purposes of any one of Level 1 and added more practices at higher levels. The
the phases of a system’s life cycle. SECAM and SECM also included process effectiveness
and product value considerations, where the SE-CMM
Definitions. Table 4 shows the different definitions of
did not. The SECM maturity scale specifies “generic
system and systems engineering in the standards and
attributes” which rate these non-process aspects. Fi-
models. The definitions show that the standards are
nally, the SECM traces closely to the systems engi-
addressing somewhat different problems.
neering standards.
Phraseology. MIL-STD-499B used “shall” to detail
Table 5. SE Capability Models Commonality
what the contractor was responsible for doing. When
EIA/IS 632 was created from MIL-STD-499B, it kept Architecture: All three use the six-level SPICE architecture,
most of the same content. Two overall changes were to including 18 or 19 process (or focus) areas on one axis, meas-
replace the word “shall” with the present tense of the ured by Levels 0-5 capability on the other axis.
verb and to replace the term “contractor” with “per- What vs. How: All three models do not prescribe “how”, just
forming activity.” Thus, instead of saying, “the con- characteristics of good processes.
tractor shall develop items that are survivable,” EIA/IS Role: All three models do not prescribe “who” (Role independ-
632 says, “the performing activity identifies and de- ence)
fines requirements to ensure that items are survivable.” General Categories: All three models have separate catego-
This approach in EIA/IS 632 reduced the number of ries for technical, management, and organizational elements.
“shalls” to four. However, one of the “shall” statements Life Cycle Considerations: None address logistics and op-
erations very well. All three models address most other of the
called for a Systems Engineering Management Plan
12 systems engineering roles [Sheard 1996].
(SEMP) and referenced an annex which provided a
comprehensive outline of the content. Elements of the Models. Table 1 shows that the Focus
IEEE 1220 also uses the “performing activity” Areas (FAs) of the SECM are almost a 1:1 derivation
rather than contractor as the performer of standard from both the source models. SECM FAs 1.1, 1.2, and
requirements. EIA 632 uses the term “developer” for 1.3 changed emphasis in that the SECM kept all prob-
the performing activity. lem-domain ideas in 1.1 and 1.2, and all solution do-
main ideas in 1.3, whereas both source models mixed
Similarities and Differences among SE Capability
these somewhat. Content of other areas was shifted
Models. Table 5 shows that the three capability models
slightly, but in general all three models have nearly
are similar in architecture and intent. Indeed, the con-
identical process content. Data Management is not
tent and scope of all three models are similar. Primary
present in SE-CMM.
differences, shown in Table 6, are that the SE-CMM
Table 4. Definitions of System and Systems Engineering in SE Standards and Capability Models
Table 4. (continued)
IEEE 1220 The top element of the system architecture, An interdisciplinary collaborative approach to derive, evolve, and
specification tree, or systems breakdown verify a life cycle balanced system solution that satisfies customer
structure that is comprised of one or more expectations and meets public acceptability.
products and associated life cycle processes
and their products and services.
EIA 632 The aggregation of end products and ena- None— the term is not used or referred to in the standard.
bling products that achieves a given purpose.
ISO 15288 An integrated composite that consists of one None— the term is not used or referred to in the standard.
or more of the processes, hardware, soft-
ware, facilities and people, that provides a
capability to satisfy a stated need or objective.
(ISO 12207 definition adopted for ISO
15288)
SE-CMM An integrated composite of people, prod- Systems engineering is the selective application of scientific and
ucts, and processes that provide a capability engineering efforts to
to satisfy a stated need or objective. • Transform an operational need into a description of the system
(MIL-STD-499B definition) configuration which best satisfies the operational need ac-
cording to the measures of effectiveness,
• Integrate related technical parameters and ensure compatibility
of all physical, functional, and technical program interfaces in a
manner which optimizes the total system definition and design,
• Integrate the efforts of all engineering disciplines and special-
ties into the total engineering effort.
SECM The aggregation of end products and ena- An interdisciplinary approach and means to enable the realization of
(EIA/IS bling products that achieves a given purpose. successful systems.
731)
SECAM A set of interrelated components working An interdisciplinary approach and means to enable the realization of
together to accomplish a common purpose successful systems.
(CAWG). An interacting combination of ele-
ments viewed in relation to function
(INCOSE).