Professional Documents
Culture Documents
discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/317185121
CITATIONS READS
2 871
7 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Jan vom Brocke on 26 September 2017.
Abstract: Design Science Research (DSR) is now an accepted research paradigm in the Information Systems
(IS) field, aiming at developing purposeful IT artifacts and knowledge about the design of IT artifacts. A rich body
of knowledge on approaches, methods, and frameworks supports researchers in conducting DSR projects. While
methodological guidance is abundant, there is little support and guidance for documenting and effectively
managing DSR processes. In this article, we present a set of design principles for tool support for DSR processes
along with a prototypical implementation (MyDesignProcess.com). We argue that tool support for DSR should
enable researchers and teams of researchers to structure, document, maintain, and present DSR, including the
resulting design knowledge and artifacts. Such tool support can increase traceability, collaboration, and quality in
DSR. We illustrate the use of our prototypical implementation by applying it to published cases, and we suggest
guidelines for using tools to effectively manage design-oriented research.
Keywords: Design Science Research, design process
1 Introduction
Design Science Research (DSR) is now an important and legitimate research approach in the
Information Systems (IS) field (Gregor & Hevner, 2013), and the adoption of DSR has been
accelerated by the availability of various frameworks, approaches, and methods supporting the DSR
process (e.g., Kuechler & Vaishnavi, 2008; Peffers, Tuunanen, Rothenberger, & Chatterjee, 2007;
Venable, 2006). Strategies to position and present IS research to create impact (Gregor & Hevner,
2013) are intended to help researchers publish their results in highly ranked IS journals (Goes, 2014),
and high-quality DSR can now be found in our discipline’s top journals, such as MIS Quarterly and
Information Systems Research.
While there is ample evidence that DSR has matured over the past years, it is somewhat ironic that
the field has not yet developed and widely adopted computer-based tools that help researchers
document and manage the research process—considering the field’s focus on developing purposeful
IT artifacts. While such tool support is available for other areas (e.g., qualitative and quantitative
research), this is not the case for DSR.
Qualitative research, for instance, demands that researchers follow specific procedures and document
the research process in detail; they are required to provide a clear chain of evidence (Walsham 2015),
corroborate their findings (Strauss & Corbin, 1998), and report on criteria such as intercoder-reliability
(Miles, Huberman, & Saldana, 2013). To this end, the use of computer-based analysis tools such as
atlas.ti (http://atlasti.com/de/) or NVivo (http://www.qsrinternational.com/) has become a de-facto
standard. These tools support researchers in conducting their literature analysis, managing data
collection, analyzing data, and reporting from their study, and editors and reviewers indeed might ask
for coding examples or memos written during the analysis.
Similarly, DSR scholars must ensure the application of rigorous methods to construct and evaluate the
design artifact (Hevner, March, Jinsoo, & Ram, 2004), and they need to systematically plan and
structure research projects and resultant publications (Gregor & Hevner, 2013). Typical DSR
endeavors involve a set of activities ultimately leading to the creation of the design artifact, including
the identification of problem, definition of objectives, design & development, demonstration, and
evaluation (Peffers, et al., 2007). During this process, researchers need to keep track of important
decisions and document the activities carried out, the deliverables from those activities, and the
relationships between those deliverables. DSR is typically collaborative, and researchers have to
exchange and discuss (intermediate) results. Finally, the research outcomes must be archived and
made available for other researchers, reviewers, and practitioners.
Importantly, tool support for DSR must not straight-jacket and over-engineer the DSR process, which
has often been described as involving creativity and decision making (Hevner, 2007; Vaishnavi &
Kuechler, 2008). Consequently, tool support for DSR should support the situational nature of DSR as
a problem-solving paradigm—that is, researchers should not be forced into mechanically applying
existing frameworks and rules, but should be supported in their collaborative effort of making informed
design decisions in specific design contexts.
Against this background, the development of advanced tool support to structure, document, maintain,
and present DSR projects and processes 1 warrants our field’s attention. Such tool support will
ultimately increase collaboration, traceability, and quality in DSR. In this paper, we present a set of
design principles for supporting DSR as well as a prototypical implementation. MyDesignProcess.com
is a web-based platform that supports the documentation and management of DSR, based on the use
of established DSR frameworks and methodologies.
We proceed as follows. We first develop a set of broad design principles for DSR support tools
grounded in seminal methodological works on DSR. Next, we describe our prototypical
implementation that demonstrates the feasibility of the design principles. We then use four recent
examples to illustrate its application in practice. We discuss the implications for research and practice
and provide a set of guidelines for using tools to effectively manage DSR. We conclude by presenting
an outlook on planned future developments.
1 DSR projects typically follow a specific research process, involving stages such as identify problem, build solution, evaluate
solution, etc.; we are interested in tool support that helps design science researchers document their DSR process that,
naturally, is part of a project.
suitable for their study. Accordingly, tool support for managing DSR projects should allow for the use
of various approaches to DSR. Correspondingly, the first design principle (DP) is:
DP1 (principle of documentation): Provide features that allow users to create a new DSR project
documentation based on existing DSR approaches.
Besides using established DSR approaches, it is now common to adapt these approaches to the
specific needs of a project (e.g., Seidel et al. use a DSR method drawing on the method proposed by
Peffers and associates (2007)). By using templates, researchers can choose the initial structure of
their project, but this structure can be customized to best fit with the specific situation and the team’s
preferences. Correspondingly, our second design principle is:
DP2 (principle of context-sensitivity): Provide features that allow users to customize a chosen
DSR approach and align it with the situation at hand.
DSR processes consist of various stages (Peffers, et al., 2007) and unfold over time, often iteratively
(Hevner, et al., 2004; Peffers, et al., 2007; Sein, et al., 2011). Consequently, once the DSR project
and its initial structure have been created, the tool should support the research team in documenting
design iterations that contain interlinked design phases with various design activities. Correspondingly,
our third design principle is:
DP3 (principle of design as an iterative process): Provide features that allow users to document
a DSR project in terms of design iterations, design phases, and design activities.
Most DSR projects are collaborative (e.g., Lindgren, Henfridsson, & Schultze, 2004). Managing
activities and keeping track of progress is challenging and increases the effort related to managing the
project. Therefore, the tool should provide support to collaborate with others in planning and
documenting DSR. This includes elements such as registering users and maintaining user profiles.
Correspondingly:
DP4 (principle of collaboration support): Provide features that allow users to collaborate in DSR
projects.
As design science research develops knowledge at various levels of abstraction, ranging from
concrete instantiations to design principles and full-blown design theory (Gregor & Hevner, 2013), tool-
support for DSR must not only support the documentation, but also the extraction of knowledge, for
instance, through memos that allow the research team to reflect on the design choices that were
made, and to extract more general knowledge, often referred to as learning (Sein, et al., 2011).
Memos—and techniques of memo writing—are mostly known from qualitative research (Glaser, 1978;
Miles, et al., 2013; Strauss & Corbin, 1998). Correspondingly:
DP5 (principle of knowledge extraction): Provide features that support users in extracting
knowledge and documenting learning from their design DSR projects.
Communicating research results is an essential step in DSR (Hevner, et al., 2004). Interested
researchers as well as practitioners should be able to retrieve information about the DSR project, and
tools for effectively supporting DSR projects should support publishing selected results from an
(ongoing) DSR project. Correspondingly:
DP6 (principle of communication support): Provide features that allow users to effectively
communicate research results.
Finally, any tool for documenting research must ensure data privacy and security of stored
information. All research findings kept within such tool must comply with established data privacy
regulations of the researchers’ country and of the research community. Moreover, certain contents will
have to be kept confidentially. Correspondingly:
DP7 (principle of data security): Provide features that ensure data privacy and security of stored
information.
3
Tool-Support for Design Science Research
3.1. Architecture
In order to support convenient access and collaboration, MyDesignProcess.com is implemented as a
responsive web-based tool.2 The architecture follows a three-tier approach (Figure 1). The first tier
(presentation layer) is a web browser; the second tier (application logic) is implemented through an
engine using dynamic Web content technology; the third tier (storage) is implemented through a
MySQL database. The web browser sends requests to the middle tier, which services by making
queries and updates against the database, and which generates a user interface. Responsive user
interfaces are realized using JavaScript and the CSS framework Bootstrap. To decouple the data
interchange layer from the presentation layer, Ajax is used. This allows changing content dynamically
without the need to reload the entire page. The application itself is written in Python on top of the free
and open-source web framework Django, which follows the model-view-template (MVT) architectural
pattern. All DSR project data provided by the user is stored in a MySQL database.
4
Tool-Support for Design Science Research
Figure 3: MyDesignProcess.com
In what follows, key features are described in more detail, with reference to the design principles they
implement.
5
Tool-Support for Design Science Research
6
Tool-Support for Design Science Research
• Users can provide a description for each iteration, phase, and activity (Figure 6). The
description should capture the essence of the iteration, phase, and activity.
• Users can associate publication links with projects, iterations, phases, and activities (see right
hand side of Figure 6). For instance, publications might provide relevant kernel theory or
methodological guidelines that informed an entire project, an iteration, a phase, or a specific
activity.
• The tool supports the extraction of knowledge (DP5). Memos can be attached at the level of
projects, iterations, phases, and activities. In DSR, memos are an important vehicle to keep
record of design decisions as well as operational decisions. Memos further provide an
important basis to develop more abstract design knowledge based on specific DSR
processes, that is, to abstract away from a specific situation.
• In order to provide contextual information (DP2), activities can be tagged. Tags can, for
instance, describe the situation in which the activity was conducted.
• Files can be added to activities. These may include information that was collected within the
activity, for instance, in the form of interview transcripts or quantitative data from a simulation.
7
Tool-Support for Design Science Research
Seidel, Chandra Kruse, Székely, Develops design principles and Mainly informed by Peffers et al.
Gau, & Stieger (forthcoming) revises these design principles (2007).
through three rounds of
implementing, demonstrating, and
evaluating a prototypical
implementation.
Meth, Mueller, & Maedche (2015) Proposes a design theory for Informed by Kuechler & Vaishnavi
requirement mining systems (2007)
(RMSs) based on two design
principles: (1) semi-automatic
requirement mining and (2) usage
of imported and retrieved
knowledge.
Schacht, Morana, & Maedche Presents a comprehensive action Informed by Sein et al. (2011)
(2015) design research (ADR) project in
the context of managing project
knowledge reuse, specifically the
KMS artifact Just Know. The entire
process from specifying its
requirements to its implementation
is described step by step.
Houy, Niesen, Calvillo; Fettke; Presents a design research project Informed by the ARIS phase model
Loos; Krämer; Schmidt; dealing with software-supported by Scheer (1998):
Herberger; Speiser; Gass; automatic identification and 1.) requirements engineering,
Schneider & Philippi (2015), classification of argumentation 2.) development of basic model,
further development of the basic structures in German court 3.) development of technical model
concept presented in Houy, decisions. and architecture,
Niesen, Fettke, Loos (Houy, 4.) implementation and testing.
Niesen, Fettke, & Loos, 2013)
8
Tool-Support for Design Science Research
9
Tool-Support for Design Science Research
process, six design principles for a project knowledge management system were derived. The
research project followed the suggestions by Sein et al. (2011), and was divided into two consecutive
ADR cycles.
Figure 9 visualizes the retrospective documentation of the research project in MyDesignProcess.com.
Given the complexity of the research project (two design cycles, eight phases, and a total of 15
activities) and its duration of more than three years, using a DSR project tool during the actual
research project runtime would have been beneficial. The retrospective documentation shows how
MyDesignProcess.com can assist researchers in planning their research activities in the context of an
ADR project and support the documentation of various project results. Especially functionalities to
store attachments and create memos for each activity can support researchers in handling the
complexity and amount of valuable knowledge created in an ADR project.
10
Tool-Support for Design Science Research
Figure 10: Illustrative example 4: Supporting iterative flexible design phase models
4.5. Summary
Our retrospective documentation of four examples shows (1) that the research design used in this
study could be documented in MyDesignProcess.com, (2) that MyDesignProcess.com supports the
adaptation of existent DSR methodologies, and (3) that MyDesignProcess.com complements other
research tools.
11
Tool-Support for Design Science Research
Against this background, we would like to suggest some basic guidelines for using tools for
documenting DSR research projects:
• Planning: Plan ahead. In order to ensure the rigor of an DSR research project, clear
methodological steps need to be taken.
• Documentation: Carefully document the entire DSR process, including activities, outcomes,
design decisions, and operational decisions.
• Memoing: The documentation process should be supported by extensive memo writing.
Memos allow researchers to keep track of important design decisions as well as operational
decisions. As such, memos provide an important basis for the abstraction of design
knowledge, for instance, in terms of design principles, as well as for reporting from the study.
• Flexibility: While the rigorous application of DSR requires clear methodological steps, this
does not mean that researchers cannot adapt existent approaches to suit the specific situation
at hand.
• Complementarity: DSR projects are typically complex research endeavors that require the
involvement of various roles (e.g., information systems researcher, software developer,
hardware specialist, etc.) as well as various software tools. For instance, evaluation of IT
artifacts will typically involve qualitative and/or quantitative research methods. Research
teams are challenged to set up a suitable software ecosystem to support this process. Tools
such as MyDesignProcess.com should be used in combination with tools such as NVivo for
qualitative analysis or SPSS for the analysis of quantitative data.
6 Conclusion
Our design principles and prototypical instantiation are intended to contribute something to the
ongoing maturation of DSR as an important research paradigm within the Information Systems field
and beyond. Documenting and managing research projects, and thus creating a design trace, is
crucial in order to ensure traceability, collaboration, and quality in DSR projects. DSR has shown to be
a problem-solving paradigm that, with its focus on solutions, can meaningfully contribute to both IS
theory and practice. Tools such as MyDesignProcess.com add an important component to the
software ecosystems that support researchers in conducting DSR. MyDesignProcess.com is an open
solution in that it is intended to support any design science research project and to seamlessly fit into
any research ecosystem.
In the next step, we will continue to evaluate MyDesignProcess.com and to reflect and learn from its
application in practice. Through this iterative process both the underlying design principles and their
implementation will be further developed. Specifically, it is intended to collect user feedback and to
conduct focus groups with users who have used the system in real-life DSR projects for a
considerable amount of time. The development of design principles and tool will reach a stable state
once we reach saturation—that is, additional iterations do not lead to notable changes in the design
principles or their implementation.
We are excited to see how the field will adopt this sort of tool support, and we are confident that DSR
will thrive and continue to play an important role in the future development of our field.
References
Bichler, M., Frank, U., Avison, D., Malaurent, J., Fettke, P., Hovorka, D., . . . Suhl, L. (2016). Theories
in business and information systems engineering. Business & Information Systems
Engineering, 58(4), 291-319.
Brown, T. (2008). Design thinking. Harvard Business Review, 86(6), 84.
Chandra, L., Seidel, S., & Gregor, S. (2015). Prescriptive knowledge in IS research: Conceptualizing
design principles in terms of materiality, action, and boundary conditions. Paper presented at
the 48th Hawaii International Conference on System Sciences (HICSS).
Fettke, P., Houy, C., & Loos, P. (2010). On the relevance of design knowledge for design-oriented
business and information systems engineering. Business & Information Systems Engineering,
2(6), 347-358.
Glaser, B. G. (1978). Theoretical sensitivity: Advances in the methodology of grounded theory. Mill
Valley, CA: The Sociology Press.
12
Tool-Support for Design Science Research
Goes, P. B. (2014). Editor's comments: design science research in top information systems journals.
MIS Quarterly, 38(1), iii-viii.
Gregor, S., & Hevner, A. R. (2013). Positioning and presenting design science research for maximum
impact. MIS Quarterly, 37(2), 337-355.
Hevner, A. R. (2007). A three cycle view of design science research. Scandinavian Journal of
Information Systems, 19(2), 87-92.
Hevner, A. R., March, S. T., Jinsoo, P., & Ram, S. (2004). Design science in information systems
research. MIS Quarterly, 28(1), 75-105.
Houy, C., Niesen, T., Calvillo, J., Fettke, P., Loos, P., Krämer, A., . . . Gass, A. (2015). Konzeption und
Implementierung eines Werkzeuges zur automatisierten Identifikation und Analyse von
Argumentationsstrukturen anhand der Entscheidungen des Bundesverfassungsgerichts im
Digital-Humanities-Projekt ARGUMENTUM. Datenbank-Spektrum, 15(1), 15-23.
Houy, C., Niesen, T., Fettke, P., & Loos, P. (2013). Towards automated identification and analysis of
argumentation structures in the decision corpus of the German Federal Constitutional Court.
Paper presented at the 7th IEEE International Conference on Digital Ecosystems and
Technologies (IEEE-DEST).
Kuechler, B., & Vaishnavi, V. (2008). On theory development in design science research: anatomy of
a research project. European Journal of Information Systems, 17(5), 489-504.
Kuechler, W., & Vaishnavi, V. (2012). A framework for theory development in design science research:
Multiple Perspectives. Journal of the Association for Information Systems, 13(6), 395-423.
Lindgren, R., Henfridsson, O., & Schultze, U. (2004). Design principles for competence management
systems: a synthesis of an action research study. MIS Quarterly, 28(3), 435-472.
Meth, H., Mueller, B., & Maedche, A. (2015). Designing a requirement mining system. Journal of the
Association for Information Systems, 16(9), 799-837.
Miles, M. B., Huberman, A. M., & Saldana, J. (2013). Qualitative data analysis: A methods
sourcebook: SAGE Publications.
Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2007). A design science research
methodology for information systems research. Journal of Management Information Systems,
24(3), 45-77.
Schacht, S., Morana, S., & Maedche, A. (2015). The evolution of design principles enabling
knowledge reuse for projects: An action design research project. Journal of Information
Technology Theory and Application, 16(3), 5-34.
Scheer, A.-W. (1998). ARIS - Business Process Modeling (2nd ed.). Berlin: Springer.
Seidel, S., Chandra Kruse, L., Székely, N., Gau, M., & Stieger, D. (forthcoming). Design principles for
sensemaking support systems in environmental sustainability transformations. European
Journal of Information Systems.
Sein, M. K., Henfridsson, O., Purao, S., Rossi, M., & Lindgren, R. (2011). Action design research. MIS
Quarterly, 35(1), 37-56.
Strauss, A. L., & Corbin, J. (1998). Basics of qualitative research. Techniques and procedures for
developing grounded theory (2nd ed.). London, UK: Sage.
Vaishnavi, V., & Kuechler, W. (2008). Design science research methods and patterns: Innovating
information and communication technology. New York, NY: Auerbach Publications.
Venable, J. (2006). A framework for design science research activities. Paper presented at the
Proceedings of the 2006 Information Resource Management Association Conference.
13