You are on page 1of 9

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/228556143

Systems Engineering Standards And Models Compared

Article  in  INCOSE International Symposium · July 1998


DOI: 10.1002/j.2334-5837.1998.tb00086.x

CITATIONS READS
57 7,247

3 authors, including:

Sarah Sheard
Carnegie Mellon University
78 PUBLICATIONS   1,028 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Online Career Mentoring Program View project

All content following this page was uploaded by Sarah Sheard on 29 October 2017.

The user has requested enhancement of the downloaded file.


591

Systems Engineering Standards and Models


Compared
Sarah A. Sheard Dr. Jerome (Jerry) G. Lake
Software Productivity Consortium Systems Management international
2214 Rock Hill Road, Herndon, VA 20170 281 So. Pickett Street #401
(703) 742-7106; fax: (703) 742-7200 Alexandria, VA 22304
sheard@software.org (703) 751-7987; fax: (703) 751-5189
lakejg@mindspring.com

MIL-STD-499B, EIA/IS 632, IEEE 12201. In


Abstract. Currently there are five systems engineering
May of 1992, a “Coordination Copy” of the proposed
standards in various stages of release and three systems
engineering capability models. This makes it difficult MIL-STD 499B SW-CMM
to know what to use as a basis for process improve- 1992 Draft
ISO
ment. This paper discusses the similarities and differ- EIA/IS 632 15504*
1994 IEEE 1220-1994
ences among the standards and models. The standards Trial Use (SPICE)
have been evolving from the U.S. Military to interna- IPD-
tional and commercial, with recent standards taking a CMM*
broader scope. Two capability maturity models have SECAM SE-CMM
IEEE (1.5) 1996 (1.1) 1995
been merged into a third, which is tied to the stan- EIA 632* 1220*
1998? 1998? SSE-
dards. CMM
SECM
INTRODUCTION EIA/IS 731
ISO/IEC 15288* 1998? * Not Yet Released
In the last 5 years, five systems engineering stan- 2000? Derived From
Influenced By
dards and three systems engineering capability models
have been published or begun. It is difficult for a sys- Figure 1. SE Standards and Models History
tems engineering practitioner to stay current with the
various models, understanding what is current, how it MIL-STD-499B [MIL-STD-499B 1992] was distrib-
differs from others, and when and why each version uted to reviewers. This would have updated and sig-
ought to be used. A 1997 INCOSE symposium tutorial nificantly rewritten MIL-STD-499A, Engineering
included a module that addressed the similarities and Management, and the name would have become Sys-
differences [Sheard 1997a]. This paper updates that tems Engineering. However, industry lacked consensus
material. about what ought to be included in a standard on sys-
HISTORY tems engineering, which delayed approval, and there
was a change of administrations in the Pentagon.
The Frameworks Quagmire [Sheard 1997b] ex- In June 1994, a Department of Defense initiative
cerpt shown in Figure 1 clearly indicates that confu- decreed the end of military standards other than per-
sion over systems engineering (SE) standards and formance specifications, thereby guaranteeing that
models is likely. Various standards and models have MIL-STD-499B would never be released as such. At
been released that build on each other and on other the request of a new Director for Systems Engineering
available standards and models, particularly those in within the Office of Secretary for Defense (OSD), an
the software world. Some have been heavily publicized
but not released (MIL-STD-499B and more recently,
EIA 632) and others have been less well known but 1
The released version of IEEE 1220 is also referred to as
released and endorsed by INCOSE (such as [SECAM IEEE 1220-1994. This is a “Trial-Use” standard. This is
1996]). being updated in 1998, with the most recent version re-
ferred to as IEEE P1220 (R) D1.1, 27 January 1998. These
two standards are expected to be very similar. They are
treated as one standard, called IEEE 1220, for the purpose
of this paper.
592

Electronic Industries Alliance (EIA)2 working group SE-CMM. Meanwhile, in December 1993, a group
composed of representatives from the Aircraft Industry spun off from the INCOSE SECAM working group.
Association, Department of Defense, National Security This group included eight organizations who agreed to
Industries Association, EIA, Institute of Electrical and provide full-time authors for a systems engineering
Electronics Engineers (IEEE), and INCOSE released capability maturity model [SE-CMM 1995] to be re-
in December 1994 a “commercialized” version of MIL- leased in one year’s time.
STD-499B as EIA Interim Standard (IS) 632, [EIA/IS This group, later called EPIC (for Enterprise Proc-
632 1994]. This was done with the understanding that ess Improvement Collaboration), used the Software
considerably more industry input would go into a re- Engineering Institute (SEI) of Carnegie Mellon Uni-
placement version, to be called EIA 632. In parallel, versity for project management and administrative
the IEEE also released in February 1995 a commercial support. Thus, EPIC products were released as SEI
“Trial-Use” standard IEEE 1220-1994 [IEEE 1220- documents. Version 1.0 of the SE-CMM was released
1994 1995]. IEEE 1220-1994 states that it will be in December 1994, and an associated appraisal method
merged with EIA/IS 632 into a single American Na- was released in March 1995. Version 1.1 of both were
tional Standards Institute (ANSI) standard on systems released in February and June 1996, respectively.
engineering to be jointly published by the EIA, IEEE, Unfortunately, this meant there were now two
and INCOSE.3 systems engineering models on the market. On the one
hand, the SE-CMM had the SEI’s Software CMM
EIA 632 and ISO 15288. A ballot version of the new
[SW-CMM 1993] legacy in its favor. Other organiza-
EIA 632 was made available to reviewers in August
tions took an opposite approach: some INCOSE mem-
1997. Comments were submitted, and the EIA Techni-
bers believed that anyone with a first name of “Soft-
cal Committee is expected to complete the work on the
ware” should not be speaking for systems engineering.
revision with the expectation of a summer 1998 publi-
To say there was disagreement in the field is an under-
cation. One of the intents of the revision is to use EIA
statement.
632 as an early U.S. implementation of processes for
engineering a system that are expected to be covered in SECM (EIA/IS 731). INCOSE’s Corporate Advisory
the evolving ISO standard 15288. [Martin 1998a] and Board, and the Director for Systems Engineering in
[Martin 1998b] describe the new standard and how it OSD, agreed that the two models had to come together.
has evolved from the interim standard. EPIC and INCOSE agreed to work toward a merged
The ISO standard for system life cycle processes, model, eventually called the Systems Engineering Ca-
ISO 152884, is being coordinated by the same interna- pability Model, and given the number EIA/IS 731,
tional committee that created the software life cycle since the EIA sponsored and facilitated the merger
processes standard, ISO 12207. Working Draft #2 was effort. Monthly meetings took place over a period of
released for national body review in January 1998. A years, and the initial review copy of the SECM was
first committee draft is anticipated as early as October distributed at the 1997 INCOSE symposium.
1998 with publication of the International Standard as There is considerable overlap among the models’
early as December 1999. contents, so the technical merging of the two models
turned out to be considerably easier than determining
SECAM. INCOSE sponsored a working group that
sponsorship, requirements, and the best architecture.
began in 1992 to address the assessment of systems
In 1998, a new initiative was undertaken by a new
engineering capability. This Capability Assessment
organization formed by the Director of Systems Engi-
Working Group (CAWG) delivered several incre-
neering in OSD. The group formed of industry and
mental products. The most recent Version 1.5 of the
government representatives is looking at the common
Systems Engineering Capability Assessment Model
aspects of all the capability models, including Inte-
[SECAM 1996] was released in July of 1996. Several
grated Product Development, Software, and Systems
large corporations have found this model helpful in
Engineering. The outcome of this group’s effort will
improving their systems engineering work.
have an impact on current models.
SIMILARITIES AND DIFFERENCES
2
The EIA and the Institute of Electrical and Electronics The following sections address first, what are the
Engineers (IEEE ) are two bodies approved to set stan- similarities and differences between standards and ca-
dards by the United States’ official standards-setting body,
pability models in general, then, what are the similari-
the American National Standards Institute (ANSI).
3
See Table 1 for a discussion of the outcome of this.
ties and differences among the five systems engineer-
4
Officially, ISO/IEC 15288.
593

ing standards and then, the three systems engineering speaking is a customer (an acquisition life cycle), a
capability models. contractor (a development life cycle), or even a user (a
maintenance life cycle) [Lake 1997].
Standard vs. Capability Model. Standards and Capa-
Given these variations, it is probably a good thing
bility models both describe good systems engineering,
that the capability models are meant to be used with
but do so somewhat differently. While standards must
any life cycle. However, it is probably also a good thing
go through a defined industry-approval process, in
that standards define the life cycles they are assuming.
order to meet a nation’s guidelines, such as those es-
Otherwise, the “things to do” are without a context.
tablished by ANSI, capability models can be created by
anyone with the resources. Other comparisons are Number of Elements. Most standards have fewer than
shown below. ten process elements, but the systems engineering ca-
pability models have 18 or 19. MIL-STD-499B and
What, not How. Both standards and capability models
(EIA/IS 632) show four interrelated process steps, in-
say what should be done, but try not to say how to do
cluding Requirements Analysis, Functional Analysis,
it. However, some interpret a “what” as a “how.” Often
and Synthesis, all tied to System Analysis and Control
it is a matter of perspective. Recent standards and ca-
(Balance). This last step includes processes such as
pability models have both attempted to avoid the prob-
trade studies, interface and risk management, and
lem by focusing on processes and their related activi-
configuration and data management.
ties and tasks or requirements (the “whats”), not on
IEEE 1220 separates Analysis, which is tied to all
methods and tools (the “hows”).
other process steps, from Control, which it considers to
Purpose. Capability models provide a way to evaluate be one of the process steps. EIA 632 (see Figure 2,
an enterprise’s or project’s systems engineering capa- from the January 1998 version) discusses not one
bility. They provide a multi-point scale, in each of “Systems Engineering Process,” but thirteen processes,
these cases containing six levels, showing a road map in five interrelated groupings: Acquisition and Supply
along which an organization’s process improvement (two processes), Technical Management (three proc-
effort can progress. esses), System Design (two processes), Product Reali-
U.S. military standards originally supported con- zation (two processes), and Technical Support (four
tracts, to aid the government in delivery of quality processes). These processes are intended to be imple-
products or to ensure utilization of consistent processes mented by a single developer during any phase of a
by contractors. In general, commercial standards are system’s life cycle, as applicable.
not imposed on contracts. In the case of commercial Technical Management

systems engineering standards (EIA 632 or IEEE Planning


Process
Assessment
Process
Control
Process
1220), use by an enterprise is ordinarily voluntary, as Plans
Status
Plans
Products Outcomes
is imposing a standard on a supplier as a basis for Agreement Directives

Acquisition System Product


competition or performance. Capability models theo- & Supply Design Realization
Acquisition

Requirements
Request

Implementation

Products
retically are also voluntary, though certainly with the Supply

System
Definition Process
Process Process
SW-CMM it is evident that the practices called out by Acquisition
Solution Transition
Definition To Use
a capability model have been imposed. U.S. govern- Process Process Process

ment contracting for software has in some cases im- Outcomes

posed a requirement that contractors demonstrate a Technical Support


System
minimum of Level 2 or Level 3 ranking in the SW- Analysis
Requirements
Validation
Product
Verification
Product
Validation
Process Process Process Process
CMM.
Life Cycle. Standards may prescribe a life cycle (al- Figure 2. The Processes of EIA 632
though most specify theirs as “typical” or “example”
life cycles). In general, models do not. They are in- Like EIA 632, the capability models separate out
tended to apply to any system life cycle. A discussion the pieces of System Analysis and Control as process
on the INCOSE list server about life cycles led to two elements, and place Control in a “project” or “man-
observations: 1) that many people are sure that they agement” category (see Table 1). Capability models
know the one correct life cycle, and 2) that these peo- also add a third set of elements, those which establish
ple differ on what that life cycle is. It varies not only by organizational support for systems engineering, such
industry (those making nuclear submarines naturally as training, process management, and tool support.
have a different time-based life cycle than those mak- These are included in the Application Context clause
ing cellular telephones), but also by whether the person of EIA 632.
594

Table 1. Comparison of Process, Focus, and Key Focus Areas in the Three SE Capability Models
SE-CMM (PAs) SECM(EIA/IS 731) (FAs) SECAM (KFAs)
Engineering, Technical, or Systems Engineering Areas
PA06 Understand Customer Needs and 1.1 Define Stakeholder and System 3.1 System Concept Definition
Expectations Level Requirements
PA02 Derive and Allocate Requirements 1.2 Define Technical Requirements 3.2 Requirements and Functional
Analysis
PA03 Evolve System Architecture 1.3 Define Solution 3.3 System Design
PA01 Analyze Candidate Solutions 1.4 Assess and Select 3.4 Integrated Engineering Analysis
PA05 Integrate System 1.5 Integrate System 3.5 System Integration
PA07 Verify and Validate System 1.6 Verify System 3.6 System Verification
1.7 Validate System 3.7 System Validation
PA04 Integrate Disciplines (see 2.3 below) (see 1.4 below)
Project or Management Areas
PA12 Plan Technical Effort 2.1 Plan and Organize 1.1 Planning
PA11 Monitor and Control Technical 2.2 Monitor and Control 1.2 Tracking and Oversight
Effort
(PA04 above) 2.3 Integrate Disciplines 1.4 Intergroup Coordination
(PA18 below) 2.4 Coordinate with Suppliers 1.3 Subcontract Management
PA10 Manage Risk 2.5 Manage Risk 1.7 Risk Management
(none) 2.6 Manage Data 1.8 Data Management
PA09 Manage Configurations 2.7 Manage Configurations 1.5 Configuration Management
PA08 Ensure Quality 2.8 Ensure Quality 1.6 Quality Management
Organization or Environment Areas
PA13 Define Organization’s SE Proc- 3.1 Define and Improve the Systems 2.1 Process Management and Im-
ess Engineering Process provement
PA14 Improve Organization’s SE Proc-
ess
PA17 Provide Ongoing Knowledge and 3.2 Manage Competency 2.2 Competency Development
Skills
PA15 Manage Product Line Evolution 3.3 Manage Technology 2.3 Technology Management
PA16 Manage Systems Engineering 3.4 Manage Systems Engineering Sup- 2.4 Environment and Tool Support
Support Environment port Environment
PA18 Coordinate With Suppliers (see 2.4 above) (see 1.3 above)

Is EIA/IS 731 a standard or a model? In EIA/IS 731, Table 2. SE Standards Commonalities


the distinction between standards and models blurs. Common Authors:
This is the SECM, a capability model that has been John Kordik (1,2) Blake Andrews (7,8)
submitted as a standard. Fortunately, it is a model Ken Ptack (3a,5) Don Barber (7,8)
heavily tied to the existing standards, notably EIA 632, Richard Schmidt (3a,3b,5) Curt Wells (6,8)
Jerry Lake (1,2,3a,3b,4,5) Rich Widman (7,8)
but also IEEE 1220. Thus, the release of EIA 632 and Jim Armstrong (3a), (3b), (8)
EIA/IS 731 is the first time two consistent standards (1) MIL-STD-499B, (2) EIA/IS 632,
have been in operation, one for “What to do in engi- (3a) IEEE 1220-1994, (3b) IEEE 1220, (4) EIA632,
neering systems” (632) and one for “How to measure (5) ISO 15288, (6) SE-CMM, (7) SECAM, (8) SECM
and improve your systems engineering capability” History: Figure 1 illustrates the interrelationships of the stan-
(731). dards. Standards and capability models have been influenced
by prior ones.
Similarities and differences among SE standards. Evolution: The systems engineering standards have evolved
from a military-contract-centric approach to a commercial,
The similarities among standards are summarized in voluntary-compliance approach. The focus has changed from
Table 2, the differences in Table 3. a management to a process orientation. And, although the
nature remained a total system approach, the name has
What is a systems engineering standard? Some changed from “systems engineering” to the “engineering of
authors of EIA 632 and ISO 15288 do not consider systems” to reflect that nature better.
these to be “systems engineering standards” at all.
Neither one uses the term “systems engineering.”
595

Table 3. SE Standard Differences


MIL-STD-499B EIA/IS 632 IEEE 1220 EIA 632 ISO/IEC 15288
Scope of Standard
Defines total system Defines total system Defines the interdiscipli- Defines thirteen proc- Will address both sys-
approach for the devel- approach for the devel- nary tasks that are re- esses and 34 require- tem engineering and
opment of defense sys- opment of systems. quired throughout a ments for engineering a management (business)
tems. Definition of what "the system's life cycle to system. processes.
Specification on "the performing activity" does. transform customer The focus is on imple- The focus is on the
performing activity". This standard was the needs, requirements, menting the require- “system” versus the
demilitarized version of and constraints into a ments of the standard “components,” where
MIL-STD-499B, which system solution. within a defined engi- component standards
was never officially ap- Specifies the require- neering life cycle, which like ISO/IEC 12207 -
proved by, but used ments for the systems can be applied in any Software Life Cycle
extensively by industry engineering process and enterprise-based life Processes will apply.
and the Air Force. its application throughout cycle phase to engineer
the system’s life cycle. or reengineer a system.
Level of Abstraction
Medium level of abstrac- Same as 499B More detailed than 499B Higher level of abstrac- Highest level of
tion -- Activity level - Detailed Task level tion than previous stan- abstraction.
dards, less than 15288.
System Life Cycle
Example: Example: Typical: Enterprise-Based: Life Cycle Processes:
•Pre-Concept •Market Requirements •System Definition •Assessment of •Concept Process
•Concept Exploration •Concept Definition and •Subsystem Definition Opportunities •Development Process
and Definition Feasibility •Preliminary Design •Solicitation and •Production Process
•Demonstration and •Concept Validation •Detailed Design Contract Award •Operations Process
Validation •Design and Verifica- •Fabrication, •System Concept De- •Support Process
•Engineering and tion Assembly, Integration, velopment •Decommissioning or
Manufacturing •Production and and Test •Subsystem Design Disposal Process
Development Deployment •Production and Pre-Deployment
•Production and •Operations and •Customer Support •Deployment/ Installa-
Deployment Support tion and Operations
•Operations and and Support
Support
SEMP Guidance
2-page section on SEMP 2-page section on SEMP Ten-page "informative" One requirement calls Will not be a specific
in the Detailed Require- in the Detailed Require- Annex gives SEMP tem- for the creation of an engineering plan, more
ments section and a ments section and an 8 plate. engineering plan. The than likely. But, planning
template in page template in Appen- expected outcomes (or the system life cycle and
Appendix B. dix B. expected content) of this application of the generic
Appendix on guidance Appendix on guidance plan is provided in Annex processes will likely be
for developing a SE for developing a SE C. required.
Master Schedule. Master Schedule.

engineering view (rather than, say, a “contracts” view).


In the case of EIA 632, this was because the author
A systems engineering standard might be invoked at a
group could not come to consensus on what systems
lower level, as would software or hardware standards.
engineering was, in order to create a standard for it.
Nevertheless, these two standards were considered
But they did detect a need for a standard on how to
in this paper, precisely because of all the confusion.
create systems, and were able to come to consensus on
the content. If an organization chooses to use some- Focus. Standards vary in their focus in a way that mir-
thing called “systems engineering” in performing the rors the change in industry outlook. MIL-STD-499B
processes in EIA 632, that is acceptable, but it is not was clearly focused on a single military procurement
required. and a contractual agreement between contractor and
Similarly, ISO 15288 is not a systems engineering acquirer. EIA/IS 632 focused on systems and products
standard. In this case, the scope is really higher than a in general, and IEEE 1220 added focus on the enter-
systems engineering organization would encompass, prise (larger organization) as well. EIA 632 has an
and higher even than an engineering organization’s enterprise context for the application of processes on
normal scope, although the standard is written from an whatever system it is that one is engineering when one
596

uses EIA 632. ISO 15288 is likely to take the same considered all process area content (in that case, called
approach as its software predecessor ISO/IEC 12207, base practices) to be necessary to reach Level 1,
where the focus is on a set of generic processes applied whereas the other two limited what was needed for
as appropriate to accomplish the purposes of any one of Level 1 and added more practices at higher levels. The
the phases of a system’s life cycle. SECAM and SECM also included process effectiveness
and product value considerations, where the SE-CMM
Definitions. Table 4 shows the different definitions of
did not. The SECM maturity scale specifies “generic
system and systems engineering in the standards and
attributes” which rate these non-process aspects. Fi-
models. The definitions show that the standards are
nally, the SECM traces closely to the systems engi-
addressing somewhat different problems.
neering standards.
Phraseology. MIL-STD-499B used “shall” to detail
Table 5. SE Capability Models Commonality
what the contractor was responsible for doing. When
EIA/IS 632 was created from MIL-STD-499B, it kept Architecture: All three use the six-level SPICE architecture,
most of the same content. Two overall changes were to including 18 or 19 process (or focus) areas on one axis, meas-
replace the word “shall” with the present tense of the ured by Levels 0-5 capability on the other axis.
verb and to replace the term “contractor” with “per- What vs. How: All three models do not prescribe “how”, just
forming activity.” Thus, instead of saying, “the con- characteristics of good processes.
tractor shall develop items that are survivable,” EIA/IS Role: All three models do not prescribe “who” (Role independ-
632 says, “the performing activity identifies and de- ence)
fines requirements to ensure that items are survivable.” General Categories: All three models have separate catego-
This approach in EIA/IS 632 reduced the number of ries for technical, management, and organizational elements.
“shalls” to four. However, one of the “shall” statements Life Cycle Considerations: None address logistics and op-
erations very well. All three models address most other of the
called for a Systems Engineering Management Plan
12 systems engineering roles [Sheard 1996].
(SEMP) and referenced an annex which provided a
comprehensive outline of the content. Elements of the Models. Table 1 shows that the Focus
IEEE 1220 also uses the “performing activity” Areas (FAs) of the SECM are almost a 1:1 derivation
rather than contractor as the performer of standard from both the source models. SECM FAs 1.1, 1.2, and
requirements. EIA 632 uses the term “developer” for 1.3 changed emphasis in that the SECM kept all prob-
the performing activity. lem-domain ideas in 1.1 and 1.2, and all solution do-
main ideas in 1.3, whereas both source models mixed
Similarities and Differences among SE Capability
these somewhat. Content of other areas was shifted
Models. Table 5 shows that the three capability models
slightly, but in general all three models have nearly
are similar in architecture and intent. Indeed, the con-
identical process content. Data Management is not
tent and scope of all three models are similar. Primary
present in SE-CMM.
differences, shown in Table 6, are that the SE-CMM
Table 4. Definitions of System and Systems Engineering in SE Standards and Capability Models

Standard Definition of System Definition of Systems Engineering


or Model
MIL-STD- An integrated composite of people, products, An interdisciplinary approach encompassing the entire technical
and processes that provide a capability to effort to evolve and verify an integrated and life-cycle balanced set of
499B system people, product, and process solutions that satisfy customer
satisfy a stated need or objective.
needs. Systems engineering encompasses:
a) the technical efforts related to the development, manufacturing,
verification, deployment, operations, support, disposal of, and user
training for, system products and processes;
b) the definition and management of the system configuration;
c) the translation of the system definition into work breakdown
structures; and
d) development of information for management decision-making.
597

Table 4. (continued)

Standard Definition of System Definition of Systems Engineering


or Model
EIA/IS 632 Same as MIL-STD -499B Same as MIL-STD-499B

IEEE 1220 The top element of the system architecture, An interdisciplinary collaborative approach to derive, evolve, and
specification tree, or systems breakdown verify a life cycle balanced system solution that satisfies customer
structure that is comprised of one or more expectations and meets public acceptability.
products and associated life cycle processes
and their products and services.
EIA 632 The aggregation of end products and ena- None— the term is not used or referred to in the standard.
bling products that achieves a given purpose.

ISO 15288 An integrated composite that consists of one None— the term is not used or referred to in the standard.
or more of the processes, hardware, soft-
ware, facilities and people, that provides a
capability to satisfy a stated need or objective.
(ISO 12207 definition adopted for ISO
15288)
SE-CMM An integrated composite of people, prod- Systems engineering is the selective application of scientific and
ucts, and processes that provide a capability engineering efforts to
to satisfy a stated need or objective. • Transform an operational need into a description of the system
(MIL-STD-499B definition) configuration which best satisfies the operational need ac-
cording to the measures of effectiveness,
• Integrate related technical parameters and ensure compatibility
of all physical, functional, and technical program interfaces in a
manner which optimizes the total system definition and design,
• Integrate the efforts of all engineering disciplines and special-
ties into the total engineering effort.
SECM The aggregation of end products and ena- An interdisciplinary approach and means to enable the realization of
(EIA/IS bling products that achieves a given purpose. successful systems.
731)

SECAM A set of interrelated components working An interdisciplinary approach and means to enable the realization of
together to accomplish a common purpose successful systems.
(CAWG). An interacting combination of ele-
ments viewed in relation to function
(INCOSE).

Table 6. Capability Model Differences


Attribute SE-CMM SECM (EIA/IS 731) SECAM
Focus Process only Process, plus process effectiveness and Process, plus process effec-
product value tiveness and product value
Smallest elements Practices Practices Questions
Level of elements All practices at Level 1 Basic practices at Level 1 Questions at all levels
Advanced practices at Levels 2-5
Integer ratings? Yes Not clear in draft of model No
Generic practices Generic practices apply to all Generic practices apply to all Focus Areas. Generic questions tailored for
Process Areas Two Generic Attributes apply to each Key Focus Area
non-process characteristics.
Tie to standards Influenced by Influenced by, and more explicitly tied to Influenced by
598

SW-CMM: Paulk, Mark C., Bill Curtis, Mary Beth


CONCLUSION Chrissis, and Charles V. Weber. Capability Matur-
Although the systems engineering and capability ity Model for Software, Version 1.1, Software En-
models arena currently looks complicated, there is gineering Institute, February 1993.
good news. Two models have been merged into a third,
AUTHOR BIOGRAPHIES
which is likely to replace the others and is similar
enough to both that transition should be relatively easy. Sarah A. Sheard has eighteen years experience in
This paper discusses the similarities and differ- systems engineering, including hardware systems (sat-
ences among the standards and models. The compari- ellites) and software systems such as air traffic control.
son should help individuals and organizations doing Currently, as a systems engineer at the Software Pro-
systems engineering to understand which standards ductivity Consortium, Ms. Sheard helps companies
and models are current and which are likely to be most start systems engineering process improvement efforts
useful in the future. The working groups of INCOSE and integrate software and systems engineering work
can use the information in this paper for identifying and process improvement efforts.
potential new efforts such as preparing guides and Ms. Sheard was on the original author team for the
handbooks to implement the processes of the standards, SE-CMM model and served as an author of EIA 731
or preparing models to fill the gaps identified. for half a year. Ms. Sheard is an author of the FAA-
iCMM, an integrated CMM merging the Software
REFERENCES CMM, the Systems Engineering CMM, and the Soft-
EIA/IS 632, Interim Standard: Systems Engineering. ware Acquisition CMM for the FAA.
1994. Electronic Industries Alliance, December Ms. Sheard received a B.A. in Chemistry from the
1994. University of Rochester and an M.S. from the Califor-
IEEE 1220-1994. IEEE Trial-Use Standard for Appli- nia Institute of Technology.
cation and Management of the Systems Engineer- Dr. Jerome G. Lake is the co-founder and chief sci-
ing Process, IEEE Computer Society, Institute of entist of Systems Management international (SMi), a
Electrical and Electronics Engineers, February 28, consulting and training company. Dr. Lake is one of
1995. the founders of INCOSE and has served on the board
Lake 97: “Thoughts about Life Cycle Phases: How a of directors for seven years as the first president and
System is Developed Incrementally,” Dr. Jerome G. director-at-large. He received the Founders Award in
Lake, Proceedings of INCOSE, 1997. 1996. Dr. Lake is an aerospace engineer by degree. His
Martin, James N. “Evolution of EIA 632 from an In- former positions include: pilot and R&D manager in
terim Standard to a Full Standard,” Proceedings of the U.s. Air Force; industry consultant/project manager
INCOSE, 1998. for cruise missile testing; dean at two business schools;
Martin, James N. “Overview of EIA 632: Processes for director of technology and engineering management at
Engineering a System,” Proceedings of INCOSE, the University of Maryland, and faculty member at the
1998. Defense Systems Management College. Dr. Lake rep-
MIL-STD-499B, Draft Military Standard: Systems resents INCOSE as a technical expert for the ISO
Engineering. HQ/AFSC/ EN, Department of De- 15288 effort.
fense, “For Coordination Review” draft, May 6,
1992.
Quagmire: Web site at www.software.org/quagmire.
SECAM: Systems Engineering Capability Assessment
Model (version 1.50), INCOSE, June 1996.
SE-CMM: Bate, Roger, et. al., Systems Engineering
Capability Maturity Model (version 1.1), Software
Engineering Institute, Carnegie Mellon University,
November 1995.
Sheard, Sarah A. “Twelve Systems Engineering
Roles,” Proceedings of INCOSE, 1996.
Sheard, Sarah A. “Navigating the Compliance Frame-
works Quagmire,” Tutorial, INCOSE 1997a.
Sheard, Sarah A. “The Frameworks Quagmire, A Brief
Look,” Proceedings of INCOSE, 1997b.

View publication stats

You might also like