Systematic Literature Review

(SLR)
Irawan Nurhas
Hochschule Ruhr West University of Applied Sciences
2021
Why SLR
• (W1) Synopsis of existing research on a interventions or technology-
use.
• (W2) Identify research gaps and recommend areas for further
research.
• (W3) To give a framework/background for new research efforts.
Main process of SLR
• Planning
• Systematic screening of the literature
• Analysis

(main references: Webster & Watson, 2002; Kitchenham et al., 2009)

Planning
• Defining the term & context
• Narrowing down the area of investigation
Guideline
Questions • Identification of a preliminary starting point for the thematic classification

• Identification of popular keywords and combinations of keywords from the field

• Pre-testing of keywords in the source databases (e.g Google Scholar, dblp, Microsoft
Keywords
selection academy).

• Inclusion and exclusion criteria:

• Language, type of publication, year of publication, methods,
Filtering
criteria • Thematically relevant, main topic area
Screening
• (Automatic) Based on popular scholarly database (scopus, wos, sciencedirect,
ieee, acmdl, springerlink…) in the field
Source • (Manual-semi automatic) Based on top journal in the field (journal of human
selection computer studies, computers in human behavior) - Scimago

• Based on keywords
• Based on inclusion & exclusion criteria
Literature • Forward and back search mechanism
selection • Discussion with peer (inter-rater realibility: degree of agreement?)
Analyzing
• Paper distribution (inclusion & exclusion criteria: years, topics, methods, country, etc)
• Thematic or concept mapping (systematic mapping study)
Descriptive
analysis • Authors network, popular words and words network mapping (VOSviewer, Nvivo)

• Classification and definition

• Concept matrix (webster and watson, 2002)
Conceptual
analysis • Framework development (extending initial thematic classification)

• Identify Gaps
Recommendation
• Propose further research directions
References
• Kitchenham, B., Brereton, O. P., Budgen, D., Turner, M., Bailey, J., &
Linkman, S. (2009). Systematic literature reviews in software
engineering–a systematic literature review. Information and software
technology, 51(1), 7-15.
• Webster, J., & Watson, R. T. (2002). Analyzing the past to prepare for
the future: Writing a literature review. MIS quarterly, xiii-xxiii.