You are on page 1of 6

Framework for Successful Open Source Software

Implementation in the Malaysian Public Sector

Adnan Hamid, Nasuha Lee Abdullah, Rosnah Idrus


School of Computer Sciences
Universiti Sains Malaysia
Penang, Malaysia
adnanh@usm.my; nasuha@usm.my; irosnah@usm.my

Abstract - This research is a study on the development of a needed [2]. For example, the efforts of the Bolivarian Republic
framework for successful Open Source Software (OSS) of Venezuela government in introducing policies where OSS
implementation in the Malaysian Public Sector. A preliminary usage in the public administration is mandatory [3]. South
study was done to explore the state of OSS implementation Africa (SA) is considered as the African nation pioneer to
among government agencies since the launch of the Malaysian come out with a blueprint for OSS implementation, and the SA
Public Sector OSS Master Plan on July 16, 2004. Semi-structured government is seen as one of the more dynamic governments
face-to-face interviews using open-ended questions were with regards to planning and supporting the utilisation of OSS
conducted with IT managers and IT officers in the Northern in the public sector [4].
Region of Peninsular Malaysia. The preliminary study aimed at
investigating the usage of OSS and proprietary software, the level In Malaysia, Phase II (Accelerated Adoption) of the
of OSS utilisation, the level of OSS knowledge and training of Malaysian Public Sector OSS Master Plan that was
ICT and non-ICT staff, software development and acquisition implemented during 2007-2010 aimed to accelerate the OSS
model, internal OSS manpower capabilities and skills, the user's adoption among the public sector agencies in Malaysia. Based
perception of the advantages of OSS, the user's perception of the on the Malaysian Public Sector OSS Programme Phase II
risks of OSS, and the problems or barriers in OSS Benefit Realisation Report (BRR) by Malaysian
implementation. The results of interviews show that there are Administrative Modernisation and Management Planning Unit
many problems or barriers in OSS implementation, e.g. lack of
(MAMPU), 95% (691 agencies) of the total public sector
internal OSS expertise, lack of OSS policy, and lack of top
agencies (724 agencies) have successfully adopted OSS
management support. Therefore, this study will test the
hypotheses on the success factors to OSS implementation in the
solutions following the implementation of the Malaysian
public sector and to propose a framework for successful OSS Public Sector OSS Master Plan in 2004. OSS implementation
implementation in the Malaysian Public Sector. A quantitative in the public sector agencies is classified into six (6) solution
approach using survey method via questionnaire will be areas: “desktop, infrastructure, application solutions,
performed to answer the research question where simple random distributed enterprise, high performance computing/clustering
sampling will be used. The target respondents are the IT and workload consolidation” where infrastructure, desktop, and
managers and IT officers among the sampling frame of 192 application are the most popular OSS solution areas among the
public sector agencies in Malaysia that have successfully agencies [5]. OSS has been successfully implemented in the
implemented at least three OSS solution areas. Federal Government (99.6%), State Governments (94.9%), and
Municipal Councils (95.8%). Many initiatives have been
Keywords- Open Source Software (OSS); Malaysian Public Sector pushed by MAMPU to accelerate the OSS implementation
OSS Master Plan; successful OSS implementation; simple random among public sector agencies in Malaysia. For example, a
sampling; OSS solution areas comprehensive OSS e-government systems such as e-
Complaints, e-Submissions, e-Building, e-Planning and e-
I. INTRODUCTION Licenses have been used in the Municipal Councils and five
The success in the implementation of OSS in the public state governments (Pahang, Sabah, Perak, Sarawak, and
sector can stimulate the country's economic growth especially Penang) have issued a directive on the compulsory use of
in the software industry. Public sector can independently do all OpenOffice.org, an OSS-based productivity tool, in their
the customisations without having to rely on the vendors departments [6]. Until 2013, the Malaysian government has
anymore, therefore money can be saved and also the quality of managed to save RM370 million by 921 public sector agencies
the software can be improved compared to the commercial or representing 99.6 percent of total public sector agencies at
solutions [1]. To ensure the successful OSS implementation at various levels to reduce the cost of development of information
the national level, strong support from the government is really and communication technology [7]. It has also developed 36
Malaysian companies with the Multimedia Super Corridor

978-1-5090-1636-5/16/$31.00 ©2016 IEEE


(MSC) status offering jobs to 6,206 employees, generated increase in cost by the manufacturers. Hardware and software
RM595 million revenue, and export revenue over RM234 were totally considered as different item with different price
million [8]. and not sold as a package. Furthermore, software was released
with licensing agreement and copyright protection. Maybe,
However, from the total of 691 public sector agencies that United Kingdom (UK) is the first country that issued the first
have implemented OSS, only 192 public sector agencies software pattern in 1966 [27].
(27.8%) have implemented three (3) solution areas or more
with “some form of e-government services and the lowest Therefore, a non-profit organisation, Free Software
denominator being a website”. Another 499 public sector Foundation (FSF) was formed in 1985 by Richard Stallman, a
agencies (72.2%) have implemented only one or two solution former academician from the Massachusetts Institute of
areas [9]. This analysis clearly shows that OSS implementation Technology (MIT) to champion on the Free Software (FS)
is low and OSS solutions are not fully utilised by the public development. GNU/Linux is considered as the best example of
sector agencies in Malaysia. FS that can compete with the proprietary software. FS can be
identified by four criteria as stated in Free Software Definition:
It can also be proven from the previous studies that many the freedom to execute the program, the freedom to explore on
public sectors in other countries have failed to implement OSS how the program operates and do the customisation, the
e.g. a study on the OSS utilisation in Australian State freedom to circulate copies to others, and the freedom to
Governments [10] and a study on a review of user adoption of improve the program and to share it with others [28].
OSS in Africa [4]. Studies in other countries also discovered
problems or barriers to OSS implementation in the public In 1998, the term Open Source Software first came into
sector such as lack of OSS expertise [11, 12, 13, 14, 15, 16, use when another group led by Eric Raymond and Bruce
17, 18], lack of OSS policy [11, 13, 14, 16, 18, 19], lack of top Perens, together with some FSF developers, established the
management support [13, 14, 15], negative staff attitude Open Source Initiative (OSI) as a platform for its commercial
towards OSS [13, 14, 16, 17, 18, 19], lack of OSS training [20, use (www.opensource.org). It is different from Free Software
21] , and lack of OSS awareness [15, 18]. where additional licensing is available for the combination of
closed and open source software e.g. Berkeley Distribution
Therefore, this study will test the hypotheses on the License. Developers can customise the source code and sell it
success factors to OSS implementation in the public sector. as a commercial product without having to share it with others
The research question is: What are the Critical Success Factors [29].
in OSS implementation in the Malaysian Public Sector? By
answering this question, the study hopes to verify and come
out with a framework for successful OSS implementation in B. Open Source Software in the Public Sector
the Malaysian Public Sector. The adoption of OSS among four European cities (Vienna,
Munich, Schwäbisch Hall, and Treuchtlingen) was the main
II. LITERATURE REVIEW
attraction for a study by [30] using comparative case studies.
The adoption process involved the migration from Windows to
A. Open Source Software Linux operating system. The study tried to find out reasons
why public organisations choose to migrate to OSS and also to
OSS is defined as systems that can be accessed by all users, identify the influencing factors for OSS implementation. Semi-
not only developers, without any cost and they can do structured interviews, reports and publications were used to
modifications or customisations to the source code based on collect data. NVivo software for qualitative study was used to
GNU General Public License (GNU GPL or GPL) [22]. From analyse the outcome of the interviews. The result of the study
an economic point of view, OSS is compared to traditional showed that public organisations choose to migrate to OSS
closed sources (commercial) as “a process innovation: a new because of “greater independence, effectiveness, and cost
and revolutionary process of producing software” where saving”. While “organisational structure (flat hierarchical
developers can develop and enhance the software without any structure), perceived usefulness of technology, leadership,
restricted access to the source code [23]. OSS is also described personnel expertise, legal issues, the availability of contractors,
as free software contributions from developers all around the and interest group involvement” are the influencing factors for
globe using the internet as the medium for sharing [24]. OSS implementation.
Therefore, the existence of OSS offers free alternatives and
solutions for the software developers [25]. Another case study approach was also done by [12] among
selected Sri Lankan government organisations to identify
Researchers among academician and corporate were factors that can give impact to OSS implementation. In-depth
interested in the computer software in the 1950s as an interviews were done to collect data with all levels of staff to
academic matters rather than as a business component. get the best and accurate results. The result showed that “lack
Computers were initially sold with free software installation by of OSS expertise in companies that bid for government
the manufacturers. Users were also given software support and projects, lack of internal expertise in OSS, lack of OSS support
advise by the International Business Machines Corporation and companies, and use of unlicensed proprietary software” are the
Digital Equipment Corporation [26]. But in the middle of factors that can contribute to the failure of OSS
1960s, software was not a free item anymore because of the implementation.
While in another research, [13] used qualitative research TABLE 1. HYPOTHESES

methodology to investigate the factors that influencing or


No Hypothesis
prohibiting OSS adoption in Western Cape Schools, South
Africa. Semi-structured face-to-face interviews were done to H1 OSS expertise is positively related to OSS implementation
success.
collect data using open-ended questions with experienced staffs H2 OSS policy is positively related to OSS implementation success.
from the Department of the Premier, the Department of
Education and selected users at the school level. The identified H3 Top management support is positively related to OSS
factors that influencing OSS adoption in the Western Cape implementation success.
Schools environment are “the cost benefits of OSS, strong H4 Staff attitude towards OSS is positively related to OSS
technology support and service, OSS champions, positive implementation success.
H5
attitudes, top management support, OSS policy, change OSS training is positively related to OSS implementation success.
management, allocation of resources and training”. While the H6 OSS awareness is positively related to OSS implementation
identified factors that prohibiting OSS adoption are “Microsoft success.
agreement, compatibility with proprietary software, lack of a.

slack resources, insufficient human resources and lack of time, The operationalisation of two main variables of the research
IT staff resistance, lack of top management support, lack of framework is based on the preliminary study, OSS success
OSS policy, and negative individual attitudes”. factors, OSS Success Model, and previous studies of the OSS
implementation in the public sector. These constructs are OSS
III. RESEARCH FRAMEWORK implementation success factors (independent variables) and
The purpose of this study is to determine the success factors OSS implementation success (dependent variable). For
of OSS implementation in the Malaysian Public Sector and to independent variables (OSS implementation success factors),
propose a framework for successful OSS implementation in this research identified six variables based on the results of the
the Malaysian Public Sector. Based on the previous studies, preliminary study and literature review, namely, OSS expertise,
limited research has been conducted on the development of OSS policy, top management support, staff attitude towards
successful OSS implementation framework for the Malaysian OSS, OSS training, and OSS awareness. While for dependent
Public Sector. Therefore, a research framework (as shown in variables (OSS implementation success), this research adopted
Fig. 1) is developed as a guide to this study with six hypotheses the variables of software quality, user satisfaction, community
(H1- H6) to be tested (as shown in Table 1). service quality, OSS use, and individual net benefits from a
study by [31] on OSS Success Model to measure OSS success.

IV. METHODOLOGY
OSS Implementation Success
OSS Expertise H1 This study will follow the post positivism paradigm, as one
of the most popular paradigms in research. A quantitative
Software Quality approach using survey method via questionnaire will be used to
H2 answer the research questions to test the hypotheses by
OSS Policy
analyzing the relationships between measurement variables
User Satisfaction using statistical techniques. This paradigm is chosen because
the objective of this study is to investigate the relationships
H3
Top Management between variables. However, during the initial stage of
Support
exploration and preliminary study, qualitative approach was
Community Service used with a semi-structured face-to-face interview with IT
Quality
Staff Attitude H4 managers and IT officers using open ended questions and
Towards OSS
convenience sampling among selected six public sector
agencies in the Northern Region of Peninsular Malaysia. The
OSS Training H5 OSS Use different stages of the research process will be followed as
proposed by [32]. This process is chosen because it offers
complete research process from start to finish. The first stage is
OSS Awareness H6 Individual Net
the exploration of the literatures that are related to the research
Benefits topic in order to establish the research question [32]. A
preliminary study was done as suggested by [33] to look into
the current state of OSS implementation the Malaysian Public
Sector. Next, the research problem was defined based on the
Fig. 1. Research Framework.
outcome of the exploration and preliminary study stage where
the research questions, hypotheses, and research framework
were developed. Next stage is the research design where the
sampling design and the data collection methods were decided.
In this study, simple random sampling technique will be used
as the sampling design among the sampling frame of the public Section 2 includes 33 questions on OSS implementation
sector agencies in Malaysia. While a survey method is the success factors. It has the measurement items that are adapted
approach that will be used to collect the necessary data. Next, a or adopted from the literatures for the six OSS implementation
questionnaire was developed as the research instrument and success factors constructs, namely, OSS expertise, OSS policy,
pretesting of the questionnaire were done by OSS practitioners top management support, staff attitude towards OSS, OSS
and academicians from selected government agencies with training and OSS awareness. Finally, Section 3 includes 23
OSS background. The feedback from the pretesting will be questions on the OSS implementation success. The five OSS
used to do some improvisation on the questionnaire before the implementation success constructs, namely, software quality,
actual data collection. Next, the data collection will be user satisfaction, community service quality, OSS use and
performed and the collected data will be compiled and individual net benefits are adopted from [31] based on the
analysed. The data analysis will be executed using PSPP, an updated [38] IS Success Model and the measurement items are
open source statistical analysis program and also a free also adapted and adopted from the literatures.
alternative for IBM SPSS Statistics, to test the hypotheses.
Finally, discussion and conclusion will be done based on the The sampling frame for this study is the list of 724 public
results of the data analysis. sector agencies in Malaysia (Federal and State Government)
that was downloaded from the official website of MAMPU [9].
Questionnaire will be used as the research instrument for The list included the agency name, ministry or state name, and
this research. Reliability and validity of the questionnaire will number of OSS implementation according to the solution areas.
be tested before the data analysis. Cronbach Alpha will be used However, for the purpose of this study for successful OSS
in this research to test the reliability of the measures used in the implementation, the final list for the sampling frame is 192
instrument. The instrument used in this research has a proven public sector agencies that have successfully implemented at
content and criterion related validity as it is a derivative of least three (3) OSS solution areas. This study will use simple
instruments used in the previous studies. However, since the random sampling that has “the least bias and offers the greatest
measures were modified and reworded, the content validity generalisability of the results to the entire population where
was checked again. The measures and factors used in the study every element in the population has an equal chance of being
have emerged from the literature review and exploratory study selected as a subject” [39]. In this study, generalisability is
undertaken before the development of the instrument. The possible since the list of public sector agencies is available.
questionnaire was also reviewed by researchers to ensure Sampling design and the sample size are very crucial for the
content validity. The creation of multi-item scales and review generalisability of the sample. Incorrect sampling design can
of these scales by researchers and practitioners provide our cause an error to the findings. For example, a large sample that
constructs and their associated items with content validity [34]. is more than 500 can cause Type II errors, that is the error of
The questionnaire will be administered to test the readability accepting a hypothesis that should have been rejected, where
and to ensure completeness of the questionnaire. The “weak relationships in the sample (say a correlation of 0.10
consequences of the common method bias can happen during between two variables) might reach significance levels but in
the process of answering the questionnaire by the respondents reality they may not be for the total population” [39]. To avoid
without the assistance from the researchers during the data the occurrence of this problem, this study will use the
collection [35]. The common method bias can cause bias following rules of thumb by [40] to determine the sample size:
estimates of construct reliability and validity as well as
parameter estimates of the relationship between two constructs • The applicable sample size range of most research is
[36]. Yet, the common method bias can be avoided using some between 30 and 500.
countermeasures [36]. Reference [37] suggested • The minimum sample size for subsamples or subcategories
countermeasures such as the use of “different measurement is 30.
scale” for independent and dependent variables. For this study,
the questionnaire will use a seven-point Likert scale for the • The minimum sample size for multivariate research is ten
independent variables (OSS implementation success factors) times or more based on the number of variables in the
and a five-point Likert scale for the dependent variable (OSS study.
implementation success). The hard copy of the survey The minimum sample size according to rule number 1 is
instrument will be pretested by 2 OSS practitioners and 2 30. In this study, there are two subsamples or subcategories for
academicians. The feedback from the pretesting of the samples, namely, Federal Government and State
questionnaire will give significant changes and modifications Government. Therefore, based on rule number 2, the minimum
to the format, content, clarity, layout and consistency of sample size for each category is 30. So, the total minimum
presentation of the questionnaire. sample size for this study is 60. While for rule number 3, since
The questionnaire of this study consists of three sections. there are six (6) variables in this study, the minimum sample
Section 1 includes questions on the general information, size is 60 (10 x 6 variables). Overall, to comply with rule
namely, agency's name, agency's category, respondent's current number 1 to rule number 3, the acceptable minimum sample
position, number of years of OSS implementation experience, size that will be used in this study according to [40] is 60 where
total number of IT staff in the agency, number of OSS 30 for the Federal Government and 30 for the State
practitioners in the agency and OSS solution area. While Government. The data collection will be conducted by
distributing questionnaires by post to selected public sector [3] E. Maldonado, “The Process of Introducing FLOSS in the Public
agencies. Mail surveys are considered as the most suitable Administration: The Case of Venezuela.,” Journal of the Association for
Information Systems, vol. 11, no. 11, pp. 756–783, Nov. 2010.
method for “community-based studies” and “large or
[4] J. Kamau and S. Namuye, “A review of users adoption of open source
geographically dispersed populations” like Malaysia and also software in Africa,” Computer and Information Science, vol. 5, no. 5, p.
can be carried out in short periods of time and in an economical p45, 2012.
manner [41]. Survey questionnaires will be sent to the [5] MAMPU, “Malaysian Public Sector Open Source Software Programme
respondents among a total population of 192 public sector Phase II Benefit Realisation Report (BRR).” 2010.
agencies (Federal and State Government) in Malaysia [9]. They [6] J. Thomas Jr, “OPEN SOURCE SOFTWARE: AN ENABLER OF
will be invited to participate in the survey by sending them a MALAYSIA’S VISION 2020 TRANSFORMATION,” EDITORIAL
survey package which included a cover letter, a hard copy of COMMITTEE, p. 40, 2010.
the survey questionnaire and a reply-paid envelope. The cover [7] Berita Harian, “OSS jimat perbelanjaan kerajaan RM370j,” 16-Jul-2013.
letter will explain the purpose and objective of the survey. The [Online]. Available:
http://www2.bharian.com.my/articles/OSSjimatperbelanjaankerajaanRM
respondents will be assured of the confidentiality of their 370j/Article/. [Accessed: 10-Jun-2015].
responses and they will be given a week to return back the [8] New Straits Times, “Open source system proves effective in public
questionnaires. It is expected that the response to the survey sector,” 16-Jul-2013. [Online]. Available:
would be low, therefore, follow up requests will be done after http://www2.nst.com.my/nation/general/open-source-system-proves-
seven days. The survey questionnaire will ask for information effective-in-public-sector-1.320195. [Accessed: 15-Aug-2015].
about the OSS implementation in their agency and their [9] MAMPU, “OSS Adoption Statistics (Malaysian Public Sector Open
opinion on the success factors for successful OSS Source Software Programme).” 06-Dec-2010.
implementation. Therefore, government officers among IT [10] A. Haider, “Open Source Software Utilization in Australian State
Governments,” 2008.
Manager and IT Officer will be chosen as the respondents in
this survey. The job functions of these groups of respondents [11] A. Haider and A. Koronios, “Promises Of Open Source Software For
Australian Government Agencies-An Exploratory Study,” PACIS 2009
are managing, developing, implementing or maintaining OSS Proceedings, p. 16, 2009.
software projects at the government sector besides monitoring [12] S. Jayawardena and G. Dias, “Free and Open Source Software for Public
the entire OSS development processes. Thus, these groups of Sector Enterprise Applications in Sri Lanka,” in International
respondents are classified as most suitable respondents to Conference on Information Management and Evaluation, 2011, p. 239–
participate in this survey as they are likely to be able to provide IX.
a comprehensive evaluation of their organisation’s experience [13] K. Johnston, S. Begg, and M. Tanner, “Exploring the factors influencing
of the OSS implementation and its effects on performance [42]. the adoption of Open Source Software in Western Cape schools.,”
International Journal of Education & Development using Information &
Communication Technology, vol. 9, no. 2, pp. 64–84, Mar. 2013.
V. CONCLUSION [14] J. Mtsweni and E. Biermann, “An investigation into the implementation
of open source software within the SA government: an emerging
Generally, OSS solutions are not fully utilised by the public expansion model,” presented at the Proceedings of the 2008 annual
sector agencies in Malaysia and it is also proven through research conference of the South African Institute of Computer
literatures that many public sectors in other countries have Scientists and Information Technologists on IT research in developing
failed to implement OSS successfully. Therefore, the research countries: riding the wave of technology, 2008, pp. 148–158.
framework will guide the empirical study through which [15] Stephen Mutula and Tumelo Kalaote, “Open source software
hypotheses will be validated to answer the research question. deployment in the public sector: a review of Botswana and South
Africa,” Library Hi Tech, vol. 28, no. 1, pp. 63–80, Mar. 2010.
By understanding the critical success factors in OSS
[16] A. Oram, “Promoting Open Source Software in Government: The
implementation, the findings of this study can benefit the Challenges of Motivation and Follow-Through,” Journal of Information
agencies in the Malaysian Public Sector in implementing OSS Technology & Politics, vol. 8, no. 3, pp. 240–252, Jun. 2011.
effectively and successfully. [17] D. Richter, Hangjung Zo, and M. Maruschke, “A Comparative Analysis
of Open Source Software Usage in Germany, Brazil, and India,”
Computer Sciences and Convergence Information Technology, 2009.
ACKNOWLEDGMENT ICCIT ’09. Fourth International Conference on, pp. 1403–1410, Nov.
The authors would like to thank the School of Computer 2009.
Sciences, Universiti Sains Malaysia for supporting the [18] A. Zhussupova and A. A. Rahman, “Open source software adoption in
publication of this paper. public organizations of Kazakhstan,” Open Systems (ICOS), 2011 IEEE
Conference on, pp. 417–422, Sep. 2011.
[19] C. Amega-Selorm and J. Awotwi, “Free and open source software
REFERENCES (FOSS): it’s significance or otherwise to the e-governance process in
Ghana,” in Proceedings of the 4th International Conference on Theory
and Practice of Electronic Governance, Beijing, China, 2010, pp. 91–
[1] H. R. Varian and C. Shapiro, “Linux adoption in the public sector: An 95.
economic analysis,” Manuscript. University of California, Berkeley,
2003. [20] D. Brink, L. Roos, J. Weller, and J.-P. Van Belle, “Critical success
factors for migrating to OSS-on-the-desktop: common themes across
[2] B. Rossi, B. Russo, and G. Succi, “Adoption of free/libre open source three South African case studies,” in Open Source Systems, Springer,
software in public organizations: factors of impact.,” Information 2006, pp. 287–293.
Technology & People, vol. 25, no. 2, p. 156, May 2012.
[21] N. Z. Ab Rahim, R. A. Alias, and J. Carroll, “Multiple perspectives
criteria of Open Source Software appropriation: A case study of a city
council,” Innovations in Information Technology, 2008. IIT 2008.
International Conference on, pp. 396–400, Dec. 2008.
[22] Y. Ye and K. Kishida, “Toward an understanding of the motivation of
open source software developers,” presented at the Software
Engineering, 2003. Proceedings. 25th International Conference on,
2003, pp. 419–429.
[23] A. Bonaccorsi and C. Rossi, “Why open source software can succeed,”
Research policy, vol. 32, no. 7, pp. 1243–1258, 2003.
[24] C. Gacek and B. Arief, “The many meanings of open source,” Software,
IEEE, vol. 21, no. 1, pp. 34–40, Feb. 2004.
[25] M. Weiss, T. Bailetti, and P. Carbone, “Workshop on integration of
open source components into large software systems,” presented at the
Companion to the 22nd ACM SIGPLAN conference on Object-oriented
programming systems and applications companion, 2007, pp. 750–751.
[26] K. W. Miller, J. Voas, and T. Costello, “Free and Open Source
Software,” IT Professional Magazine, vol. 12, no. 6, pp. 14–16, Dec.
2010.
[27] K. Beresford, Patenting software under the European patent convention.
Sweet & Maxwell, 2000.
[28] R. Stallman, Free software, free society: Selected essays of Richard M.
Stallman. Lulu. Com, 2002.
[29] J. Papin-Ramcharan and F. Soodeen, “Open Source Soft ware: A
Developing Country View,” Handbook of Research on Open Source
Software: Technological, Economic, and Social Perspectives, pp. 93–
101, 2007.
[30] M. Cassell, “Why Governments Innovate: Adoption and Implementation
of Open Source Software by Four European Cities,” International
Public Management Journal, vol. 11, no. 2, pp. 193–213, Jun. 2008.
[31] S.-Y. T. Lee, H.-W. Kim, and S. Gupta, “Measuring open source
software success,” Omega, vol. 37, no. 2, pp. 426–438, Apr. 2009.
[32] D. Cooper and P. Schindler, “Business Research Methods (8 th edn.)
McGrawHill: New York,” 2003.
[33] C. Kothari, Research methodology: Methods and techniques. New Age
International, 2004.
[34] M. K. Malhotra and V. Grover, “An assessment of survey research in
POM: from constructs to theory,” Journal of operations management,
vol. 16, no. 4, pp. 407–425, 1998.
[35] S.-J. Chang, A. Van Witteloostuijn, and L. Eden, “From the editors:
Common method variance in international business research,” Journal of
International Business Studies, vol. 41, no. 2, pp. 178–184, 2010.
[36] P. M. Podsakoff, S. B. MacKenzie, and N. P. Podsakoff, “Sources of
method bias in social science research and recommendations on how to
control it,” Annual review of psychology, vol. 63, pp. 539–569, 2012.
[37] R. E. Johnson, C. C. Rosen, and E. Djurdjevic, “Assessing the impact of
common method variance on higher order multidimensional
constructs.,” Journal of Applied Psychology, vol. 96, no. 4, p. 744, 2011.
[38] W. H. Delone and E. R. McLean, “The DeLone and McLean model of
information systems success: a ten-year update,” Journal of management
information systems, vol. 19, no. 4, pp. 9–30, 2003.
[39] U. Sekaran, Research methods for business: A skill building approach.
John Wiley & Sons, 2006.
[40] J. T. Roscoe, Fundamental research statistics for the behavioral
sciences [by] John T. Roscoe. Holt, Rinehart and Winston, New York,
NY., 1975.
[41] S. E. MacDonald, C. V. Newburn-Cook, D. Schopflocher, and S.
Richter, “Addressing nonresponse bias in postal surveys,” Public Health
Nursing, vol. 26, no. 1, pp. 95–105, 2009.
[42] F. Wu, V. Mahajan, and S. Balasubramanian, “An analysis of e-business
adoption and its impact on business performance,” Journal of the
Academy of Marketing Science, vol. 31, no. 4, pp. 425–447, 2003.

You might also like