Systematic Literature Review: the Important Factors in Assessing the Trustworthiness of OSS

(*) Corresponding author

Authors' affiliations

DOI's assignment:
the author of the article can submit here a request for assignment of a DOI number to this resource!
Cost of the service: euros 10,00 (for a DOI)


Background: Trustworthiness takes an important attention in software development
paradigm. It is one of the important aspects in software adaptation. This confidence characteristic works more closely in OSS development paradigm where development practice is more abstract.
Aims: This paper is set out to examine the factors in the evaluation of trustworthiness of open source software
Method: This systematic literature review surveyed the articles published between 2007 and 2012 in five most repository of research paradigm.
The results: The study identified the reliability and interoperability as the top most important factors for the OSS practitioners to take into consideration in their software adaptation.
Conclusion: The study discusses the systematic literature review on how to identify the trustworthiness of the open source software and find out that reliability is the highest ranking factors that is needed to be considered in the adoption of the software. Further theoretical and empirical research is still needed on this area. Researchers can work more in this area by validating these findings empirically to gain more facts about this area

Copyright © 2013 Praise Worthy Prize - All rights reserved.


Trustworthiness; Open Source Software; Reliability, Interoperability; Trustworthiness

Full Text:



B. A. Kitchenham, Procedures for Undertaking System Review, Joint Technical Report, Computer Science Department Keele University (TR/SE-o401) and National ICT Australia Ltd. (0400011T.1), 2004.

A. Ankolekar, J. D. Herbsleb, K. Sycara. Addressing Challenges to Open Source Collaboration with the Semantic Web, 3rd Workshop on Open Source Software Engineering, ICSE’03 International Conference on Software Engineering Portland, Oregon May 3-11, 2003, Pages 9-13.

L. Lavazza. Beyond Total Cost of Ownership: Applying Balanced Scorecards to Open-Source Software, pp. 74-8x, Software Engineering Advances, 2007. ICSEA 2007. International Conference on.

K. Ven, J. Verelst, H. Mannaert. Should You Adopt Open Source Software? IEEE Software, Volume 25, (Issue 3), 2008, pages 54-59.

S. Masupe, S. M. Sheikh. Developing a Low Cost Open Source Research Portal, (2012) International Journal on Communication Antenna and Propagation (IRECAP), 2 (5), pp. 296-301.

B. Fitzgerald. The Transformation of Open Source Software. MIS Quarterly, Volume 30, (Issue 3), 2006, Pages 587-598

K. Ven, P. De Bruyn. "Factors Affecting the Development of Absorptive Capacity in the Adoption of Open Source Software." International Journal of Open Source Software and Process, Volume 3, (Issue 1), 2011, Pages 17-38.

L. Yao, W. Yang, A Context-Aware Recommender for Trustworthy Service, (2012) International Review on Computers and Software (IRECOS), 7 (6), pp. 3354-3359.

E. Raymond. The cathedral and the bazaar. (1998).

T. J. Gandomani, H. Zulzalil, A. A. Abd Ghani, A. B. Sultan, A Systematic Literature Review on Relationship between Agile Methods and Open Source Software Development Methodology, (2012) International Review, on Computers and Software (IRECOS), 7 ( 4), Pages 1602-1607.

L. Morgan, P. Finnegan. How Perceptions of Open Source Software Influence Adoption: An Exploratory Study. Proc. 15th European Conf. Information Systems (ECIS 07), Univ. of St. Gallen, 2007, Pages 973–984.

A. D. Bakar, A. Sultan, H. Zulzalil, J. Din, Review on ‘Maintainability’ Metrics in Open Source Software, (2012) International Review on Computers and Software (IRECOS), 7, (3), pp. 903-908.

Y. Jusoh, K. Chamili, J. H. Yahaya, N. C. Pa, Using the Rasch Model to Validate Selection Criteria for Open Source Software, (2012) International Review on Computer and Software (IRECOS) 7, (6), pp. 3118-3123.

L. Bernstein, “Trustworthy Software System,” SIGSOFT Software Eng. Notes, Volume 30, (Issue 1), 2005, Pages 4-5.

B. Fitzgerald. "Open Source Software Adoption: Anatomy of Success and Failure." IJOSSP, Volume 1, (Issue 1), 2009, Pages 1-23. doi:10.4018/jossp.2009010101

Y. Li. Open Source Software Adoption: Motivations of Adopters and Amotivations of Non-adopters, The DATA BASE for Advances in Information Systems 76 Volume 42, (Issue 2), 2011, Pages 76-94.

M. T. Connolly, E A. Boyle, E. MacArthur, T. Hainey, J. M. Boyle, A systematic literature review of empirical evidence on computer games and serious games, Computers & Education. Volume 59, 2012, Pages 661–686.

C. Okoli, K. Schabram. "A Guide to Conducting a Systematic Literature Review of Information Systems Research," Sprouts: Working Papers on Information Systems. Volume 10, (Issue 26), 2010.

Abu Bakar Md. Sultan, Abubakar Diwani Bakar, Hazura Zulzalil, Jamilah Din, Systematic Literature Review in Open Source Software Maintainability, (2012) International Review On Computers And Software (IRECOS), 7, (5), pp. 2200-2205.

ISO, “ISO 8402 Quality Vocabulary,” in International Organization for Standardization, (Geneva, 1986).

Center for Reviews and Dissertation. What are the Criteria for Inclusions of Reviews on DARE? 2007, htto://, 2007.

V. del Bianco, V., Lavazza, L., Morasca, S. & Taibi, D. A Survey on Open Source Software Trustworthiness IEEE Software, 2012, Volume 28(Issue 5), Pages 67-75.

J. Li, R. Conradi, C. Bunse, M. Torchiano, O. N. Slyngstad, M. Morisio, Development with Off-The-Shelf Components: 10 Facts, IEEE Software, Volume 26, (Issue 2), 2009.

K. Ven, J. Verelst, H. Mannaert, “Should You Adopt Open Source Software?” IEEE Software, Volume 25, (Issue. 3), 2008, Pages 54-59.

D. Taibi, L. Lavazza, S. Morasca, “ OpenBQR: A Framework for the Assessment of OSS,” Open Source Development, Adoption and Innovation, Volume 234, 2007, Pages. 173-186.

J. Ven, J. Verelst, “The Importance of External Support in the Adoption of Open Source Server Software,” Proc. International Conf. Open Source Softwares (OSS 2009), Springer, 2009, Pages 116-128

A. Immonen, M. Palviainen, “Trustworthiness Evaluation and Testing of Open Source software Components”, Seventh Int. Conference on Quality Software (QSIC 2007), IEEE, Pages 316-321

S. Morasca, D. Taibi, D. Tosi, Towards Certifying the Testing Process of Open Source Software: New Challenges or Old Methodologies?”, FLOSS’09, May 18, 2009 IEEE.

A. Cassar, M. Rigdon, “Trust and Trustworthiness in Network Exchange”, Games and Economic Behavior71, Volume 71, (Issue 2), March 2011, Pages 282–303, Elsevier, 2011.

S. Ding, S. Yang, C. Fu, “A novel evidential Reasoning Based Method for Software Trustworthiness Evaluation under the Uncertain and Unreliable Environment”, Expert Systems with Applications, Volume 39, (Issue 3), February 2012, Pages 2700-2709.

V. Del Bianco, L. Lavazza, S. Morasca, D. taibi, D. Tossi “The QualiPSO Approach to OSS Product Quality Evaluation”, Proceeding of the 3rd FLOSS’10, Pages 23-28, 2010.

M. Sicilia and E. García. On the Concepts of Usability and Reusability of Learning Objects, The International Review of Research in Open and Distance Learning, Volume 4. (Issue 2), 2003, Pages 1-11.

P. Sfetsos, I Stamelos, Empirical studies on Quality in Agile Practices: A Systematic Literature review, IEEE Conference Publications, Quality of Information and Communication Technology (QUATIC), 2010 Seventh International Conference, (2010).

J. C. Bare and N. S. Baliga. Architecture for interoperable software in biology, Brief in Bioinformatics, Volume 14, (Issue 1), 2012, Pages 1-11.

P. Sfetsos, I Stamelos, Empirical studies on Quality in Agile Practices: A Systematic Literature review, IEEE Conference Publications, Quality of Information and Communication Technology (QUATIC), 2010 Seventh International Conference, (2010).

M. Hertzum, “The Importance of Trust in Software Engineers’ Assessment and Choice of Information Source,” Information and Organisation, Volume 12, (Issue 1), 2002, Pages 1-18.

H. Danie, K. Diane, “Testing for Trustworthiness in Scientific Software”, Proceeding of 2009 ICSE Workshop on SECE’09, 2009.

E. Amoroso, C. Taylor, J. Watson, M. Marietta, J. Weiss, A Process-Oriented Methodology for Assessing and Improving Software Trustworthiness, Proc. 2nd ACM Conf. Computer and Communications Security, ACM Press, 1994, Pages 39-50.


  • There are currently no refbacks.

Please send any question about this web site to
Copyright © 2005-2022 Praise Worthy Prize