The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Journal Article

Is a Multi‑Criteria Evaluation Tool Reserved for Experts?  pp151-162

C. Sanga, I. M Venter

© Feb 2010 Volume 12 Issue 2, Editor: Shaun Pather, pp129 - 198

Look inside Download PDF (free)


The objective of this investigation was to determine whether the analytical hierarchy process algorithm is suitable for the evaluation of software by evaluators with little Information Technology experience. The scope of the research was the evaluation of two free and open source e‑learning systems at the Open University of Tanzania using 33 stakeholders with diverse levels of Information Technology experience. Both quantitative and qualitative research methods were used. The qualitative methods comprised participative observation and interviews. Questionnaires and the analytical hierarchy process, a multiple‑criteria decision‑ making algorithm, represented the quantitative methods. The results showed that of the two e‑learning systems evaluated, Moodle was preferred over ATutor. Furthermore it was found that the analytical hierarchy process algorithm is appropriate for the evaluation of software in a situation where Information Technology experience is limited. It is anticipated that the paper contributes to the theory and practise of decision making in developing countries such as Tanzania.


Keywords: free and open source software, e-learning systems, software quality, multi-criteria evaluation tool, analytical hierarchy process, novice user, developing country


Share |

Journal Issue

Volume 12 Issue 2 / Dec 2009  pp129‑198

Editor: Shaun Pather

View Contents Download PDF (free)

Keywords: analytical hierarchy process, B2C e-commerce, collective use, DeLone and McLean, developing country, e-commerce Success, e-learning systems, electronic marketplace, ex-post evaluation, free and open source software, ICT evaluation, ICT in tertiary education, ICT investment management, innovative use, investor structure, IS success, MIS, multi-criteria evaluation tool , net benefits, novice user, onfigural use, online television, online video, ownership, performance evaluation and improvement, small-to-medium enterprises, software quality, technology adoption, theory of planned behaviour, user acceptance of online videos, web TV, work-arounds


Share |