The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Journal Article

Theory, Method and Tools for Evaluation Using a Systems‑based Approach  pp139-154

Päivi Jokela, Peter Karlsudd, Martin Östlund

© Nov 2008 Volume 11 Issue 3, Editor: Dan Remenyi, pp109 - 212

Look inside Download PDF (free)


This work introduces an evaluation model for examining organisations that in one form or another depend on modern information technology for their core activities. The evaluation model, named SUV, is based on a systems science approach and has been developed at the eHealth Institute (eHälsoinstitutet) at the University of Kalmar. The central mechanism of the model, the SUV diagram, partitions the scope of evaluation into seven categories and three levels. The seven categories have been selected on a systems science basis with inspiration from systems thinking. The rationale for making this the starting point for the evaluation model is that it may be justifiably stated that the framework provided by systems thinking truly encompasses the breadth of human activity. Making use of this general framework, the SUV diagram provides a general roadmap to guide the evaluation effort. The three levels (organisation, technological and individual) were selected to add detail to the analysis complement the categories and enrich the analysis of each category as well as to the dynamic interplay among them. The SUV methodology is based on a continuous evaluation process whose driving‑force is the wish of the interested parties to develop their own activities. It is a methodology within whose framework any and all methods for data gathering deemed appropriate for the evaluation at hand can be used. The use of multiple methods is explicitly encouraged for the purpose of gaining a multi‑perspective view of the organisationactivity under scrutiny. Based on the accumulated findings from pilot studies, the model was operationalised in the form of an IT application for electronic surveys. The application is expected to contribute in making the evaluation process more efficient and add structure to this process.


Keywords: systems science, systems thinking, evaluation methodology, multi-method, electronic surveys


Share |

Journal Issue

Volume 11 Issue 3 / Nov 2008  pp109‑212

Editor: Dan Remenyi

View Contents Download PDF (free)

Keywords: B2C e-commerce, boundary objects, business-to-business integration, Caribbean, data functionality , data ownership, DeLone and McLean, developing countries, e-commerce success, economic profit, electronic surveys, evaluation methodology, Gulf Cooperative Council (GCC), information and communication technologies (ICT), inter-organizational data integration problems, IS evaluation, IS management, IS outsourcing , IS Project Management, IS success, Middle East, multi-method, Oman, product management, project management, Project Objectives Measurement Model (POMM), service levels, SERVQUAL, Small and Medium Sized Enterprises, SME, success criteria, systems science, systems thinking, traceability, WWW, service-quality


Share |