Open Access Open Access  Restricted Access Subscription or Fee Access

Evaluating Open Source Software Usability Using a Multistage Fuzzy Model Approach

(*) Corresponding author

Authors' affiliations



In recent years, development of Open Source Software has obtained significant importance in the production of software products. Although, developers of Open Source Software have developed software with functional competitiveness as compared to closed proprietary software; computer users still prefer closed proprietary software than open source due its usability strength. On the other hand, once the usability of OSS is evaluated, it would be easier to develop and implement an acceptable and qualitative product, since the software usability is considered to be one of the most important quality factors. Thus, this work proposed a multistage fuzzy model approach for evaluating the Open Source Software usability, which includes nine usability characteristics to be taken into account when designing and implementing OSS software. The model takes a project, developed in MATLAB and quantifies its usability. The Analytical Hierarchy Process (AHP) technique was employed to verify the proposed model approach and to rank its usability characteristics. These characteristics are sequenced according to its importance as follows; learnability, understandability, efficiency, error prevention, memorability, operability, familiarity, attractiveness, and usability-compliance.
Copyright © 2015 Praise Worthy Prize - All rights reserved.


Open Source Software; Analytical Hierarchy Process; MATLAB; Fuzzy Model; Software Usability; Usability Characteristics

Full Text:



B. Ashley, & K. Hyunju, A survey on open source software licenses, Journal of Computing Sciences in Colleges, Vo,l. 22, n. 4, pp. 252-259, 2007.

S. M. A. Shah, G. I. G. Al-Matroushi, M . F. Qureshi, Usability Assessment of Open source application, International Journal of Advanced Research in Computer Science, Vol. 4, n. 2, 2013.‏

M. F. Qureshi, & G. I. G. Al-Matroushi, Usability Assessment of Open source application. International Journal of Advanced Research in Computer Science, Vol. 4, n. 1, pp. 13-19 , 2013.

A. Madan, & S. K. Dubey, Usability evaluation methods: a literature review, International Journal of Engineering Science and Technology, Vol. 4, n. 2, pp. 590-599, 2012.

J. Hall, Usability Themes in Open Source Software Ph.D. Thesis, Dept. Computer Science, University of Minnesota, Minnesota, USA, 2014.‏

A. Shaout, M. Al-Shammari, Fuzzy logic modeling for performance appraisal systems: a framework for empirical evaluation, Expert systems with Applications, Vol. 14, n.3, pp. 323-328, 1998.‏

A. Oztekin, Z. J. Kong, & O. Uysal, UseLearn: A novel checklist and usability evaluation method for eLearning systems by criticality metric analysis, International Journal of Industrial Ergonomics, Vol. 40, n. 4, pp. 455-469, 2010.‏

A. Raza, L. F. Capretz, & F. Ahmed, An open source usability maturity model (OS-UMM). Computers in Human Behavior, 28(4), pp. 1109-1121, 2012.‏

J. Horsky, K. McColgan, J. E. Pang, A. J. Melnikas, J. A. Linder, J. L. Schnipper, B. Middleton, Complementary methods of system usability evaluation: surveys and observations during software design and development cycles, Journal of biomedical informatics, Vol. 43, n. 5, pp. 782-790, 2010.‏

A. Fernandez, S. Abrahao, & E. Insfran, Empirical validation of a usability inspection method for model-driven Web development, Journal of Systems and Software, Vol. 86, n. 1, pp. 161-186, 2013.‏

A. Karahoca, E. Bayraktar, E. Tatoglu, & D. Karahoca, Information system design for a hospital emergency department: A usability analysis of software prototypes, Journal of biomedical informatics, Vol. 43, n. 2, pp. 224-232, 2010.‏

R. R. Bond, D. D. Finlay, C. D. Nugent, G. Moore, & D. Guldenring, A usability evaluation of medical software at an expert conference setting, Computer methods and programs in biomedicine, Vol. 113, n. 1, pp.383-395, 2014.‏

S. K. Dubey, & A. Rana, Analytical comparison of usability measurement methods, International Journal of Computer Applications, Vol. 39, n. 15, 2012.

I. S. O. (2001). IEC 9126-1: Software Engineering-Product Quality-Part 1: Quality Model. Geneva, Switzerland: International Organization for Standardization..

P. Rogers Sharp, Interaction Design-beyond human-computer interaction (John Wiley & Sons 2015).

A. McCall, P. K. Richards & G. F. Walters, Factors in Software Quality, US Rome Air Development Center Reports, US Department of Commerce, Washington DC, 1977.

K. D. Eason, Towards the experimental study of usability, Behaviour and Information Technology, Vol. 3, n.2, pp. 133-143, 1984.

B. Shackel, Usability—Context, framework, definition, design and evaluation, in B. Shackel and S. Richardson, Human Factors for Informatics Usability, Cambridge, MA: University Press, pp. 21–38, 1991.

J. Nielsen, Usability Engineering (Elsevier 1993)

B. Fitzgerald, The transformation of Open Source Software, MIS Quarterly, Vol. 30, n. 3, pp. 587–598, 2006.

R. E. Al-Qutaish, Quality models in software engineering literature: an analytical and comparative study, Journal of American Science, Vol. 6, n.3, pp. 166-175, 2010‏

G. S. Laterza. Valenti, A. Cucchiarelli, & M. Panti, Computer based assessment

systems evaluation via the ISO9126 quality model, Journal of Information Technology Education, Vol. 1, N.3, pp. 157-175, 2002.

T. A. Kroeger, N. J., Davidson, & S. C. Cook, Understanding the characteristics of quality for software engineering processes: A Grounded Theory investigation. Information and Software Technology, Vol. 56, n. 2, pp. 252-271, 2014.‏

T. A. Al-Rawashdeh, F. M. Al’azzeh, S. M. Al-Qatawneh, Evaluation of ERP Systems Quality Model Using Analytic Hierarchy Process (AHP) Technique. Journal of Software Engineering and Applications, Vol. 7, n. 4, pp. 225-232, 2014.‏

A. Kumar, P. S. Grover, & R. Kumar, A quantitative evaluation of aspect-oriented software quality model (AOSQUAMO), ACM SIGSOFT Software Engineering Notes, Vol. 34, n. 5, pp. 1-9, 2009.

P. Booth, An introduction to human-computer interaction. Hillsdale, (Lawrence Erlbaur Associates Publishers, 1989).

Benson, M. Muller-Prove, & J. Mzourek, Professional usability in open source projects: GNOME, OpenOffice. org, NetBeans, CHI’04 extended abstracts on Human Factors in Computing Systems (page:1083 year of publication 2004).

S. L. Pauwels, C. Hubscher, S. Leuthold, J. A. Bargas-Avila, & K. Opwis, Error prevention in online forms: Use color instead of asterisks to mark required-fields, Interacting with Computers, Vol. 21, n. 4, pp. 257-262, 2009.‏

N. Bevan, ISO and industry standards for user centered design. Retrieved November 23 (2000), 2010.‏

A. Maedche, A. Botzenhardt, & L. Neer, Software for people: Fundamentals, trends and best practices (Springer Science & Business Media, 2012).‏

A. Seffah, M. Donyaee, R. B. Kline, H. K. Padda, Usability measurement and metrics: A consolidated model, Software Quality Journal, Vol. 14, n. 2, pp. 159-178, 2006.‏

L. Casalo, C. Flavián, & M. Guinaliu, The role of perceived usability, reputation, satisfaction and consumer familiarity on the website loyalty formation process, Computers in Human Behavior, Vol. 24, n. 2, pp. 325-345, 2008.‏

Y. Shin, L. Williams, Can traditional fault prediction models be used for vulnerability prediction, Empirical Software Engineering, Vol. 18, n. 1, pp. 25-59, 2013.

A. Shaout, J. Trivedi, Performance appraisal system using a multistage fuzzy architecture, International Journal of Computer and Information Technology, Vol. 2, n. 3, pp. 405-411, 2013.‏

T. L. Saaty, What is the analytic hierarchy process? (Springer Berlin Heidelberg 1988).

T. J. Ross, Fuzzy logic with engineering applications (John Wiley & Sons. 2009).

K. Dahal, Z. Hussain, & M. A. Hossain, Loan risk analyzer based on fuzzy logic. Proceedings. The IEEE International Conference on e-Technology, e-Commerce and e-Service (page: 363 year of publication 2005).

S. K. Dubey, & A. Rana, Fuzzy Model for Quantifying Usability of Object Oriented Software System, International Journal of Computer Science and Information Security, Vol. 10, n. 4 2012.‏

L. A. Zadeh, Fuzzy sets. Information and control, Vol. 8, n. 3, pp. 338-353 , 1965.‏

E. M. Fredericks, B. DeVries, & B. H. Cheng, AutoRELAX: automatically RELAXing a goal model to address uncertainty, Empirical Software Engineering, Vol. 19, n. 5, pp. 1466-1501, 2014.

B. Adams, R. Kavanagh, E. A. Hassan, & D. M. German, An empirical study of integration activities in distributions of Open Source Software.Empirical Software Engineering, Vol. 20, n. 1, pp. 1-42, 2015.

S. M. Alnaeli, J. I. Maletic, & M. L. Collard, An empirical examination of the prevalence of inhibitors to the parallelizability of Open Source Software systems. Empirical Software Engineering, Vol. 20, n.2 pp. 1-30, 2015.

B. W. Boehm, J. R. Brown, H. Kaspar, H. Lipow, G. McLeod, & M. Merritt, Characteristics of Software Quality, (North Holland Publishing, 1978).

R. G. Dromey, Cornering the chimera. IEEE Software, Vol. 1, n. 1, pp. 33-43, 1996.

S. Fahmy, N. Haslinda, W. Roslina, & Z. Fariha, Evaluating the Quality of Software in e-Book Using the ISO 9126 Model, International Journal of Control and Automation, Vol. 5, n. 2, pp. 115-122, 2012.‏

ISO 9241, Ergonomics requirements for office work with visual display terminals (VDTs) – Part 11: Guidance on usability, 1998.


  • There are currently no refbacks.

Please send any question about this web site to
Copyright © 2005-2024 Praise Worthy Prize