The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

Evaluating the Benefits of Regional Electronic Marketplaces: Assessing the Quality of the REM Success Model  pp11-20

Denise E Gengatharen, Craig Standing

© Jan 2004 Volume 7 Issue 1, Editor: Dan Remenyi, pp1 - 66

Look inside Download PDF (free)

Abstract

A number of regional Internet electronic marketplaces (REMs) have failed or are floundering, partly due to the lack of proper evaluation of their costs and benefits. This paper uses a conceptual REM Success Model to examine the costs and benefits of a REM in Western Australia. The model has been derived from an extension to the Updated DeLone & McClean IS Success Model. The findings from the case study indicate that the REM Success Model, which includes cognisance of SME‑profile and motivation of the market maker, allows up‑front identification of the costs and benefits to all stakeholders.

 

Keywords: E-Commerce, Regional Electronic Marketplaces, Small and Medium Enterprises, SMEs, Evaluation of Benefits, REM Success Model

 

Share |

Journal Article

Developing an Evaluation Instrument for e‑Commerce Web Sites from the First‑Time Buyer's Viewpoint  pp31-42

Wei-Hsi Hung, Robert J McQueen

© Jan 2004 Volume 7 Issue 1, Editor: Dan Remenyi, pp1 - 66

Look inside Download PDF (free)

Abstract

This paper presents the process of developing an evaluation instrument specifically for the evaluation of e‑Commerce Web sites from the first‑time buyer's viewpoint. The development process is based on theoretical discussions of the Web evaluation and Web user satisfaction literature. A draft evaluation instrument was developed. To enhance its reliability and validity, several iterative trials on e‑Commerce Web sites were conducted. Some modifications were made to the instrument. The final version is capable of evaluating e‑ Commerce Web sites effectively. The instrument provides implications to both Web evaluation practitioners and academics.

 

Keywords: e-Commerce, Web evaluation, user satisfaction, transaction activity, instrument

 

Share |

Journal Article

Modelling Risks in ISIT Projects through Causal and Cognitive Mapping  pp1-10

Abdullah J. Al-Shehab, Robert T. Hughes, Graham Winstanley

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Software systems development and implementation have become more difficult with the rapid introduction of new technology and the increasing complexity of the marketplace. This paper proposes an evaluation framework for identifying the causes of shortfalls in implemented information system projects. This framework has been developed during a longitudinal case study of a problematic project, which is described.

 

Keywords: causal and cognitive mapping, project evaluation, information systems project risk

 

Share |

Journal Article

Seven Ways to get Your Favoured IT Project Accepted — Politics in IT Evaluation  pp31-40

Egon Berghout, Menno Nijland, Kevin Grant

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

IS managers are being put under increasing pressure to justify the value of corporate ITIS expenditure. Their constant quest for the 'holy grail' continues, as existing methods and approaches of justifying ITIS expenditure are still failing to deliver. The decision making process is not as objective and transparent as it is claimed or intended to be. This paper discusses seven commonly used tactics used by business managers to influence IT appraisals. The paper takes a 'devil's advocate' position and adopts some irony when looking at the area of power and politics in IT evaluation. Rather than promoting the use of these techniques, this article aims to raise awareness that IT evaluation is not as rational as most IT evaluation researcherspractitioners would want it to be or indeed claim it to be. It is argued that rationalisation or counter tactics may counteract influence techniques in an attempt to get behind the cloak and dagger side of organisational power and politics, but politics and power in decision‑making cannot and should not be filtered out. Due to dissimilarities of objectives, limitations of time and information, influence techniques will always be used. However, rather than being counterproductive, these techniques are essential in the process of decision making of IT projects. They help organisations reach better decisions, which receive more commitment than decisions that were forced to comply with strictly rational approaches. Awareness of the influence and manipulation techniques used in practice will help to deal with power and politics in IT evaluation and thereby come to better IT investment decisions.

 

Keywords: IT Evaluation, IT Decision Making, IT Assessment, Information Economics, Decision Making, Organisational Power & Politics Information Management

 

Share |

Journal Article

Exception‑Based Approach for Information Systems Evaluation: The Method and its Benefits to Information Systems Management  pp51-60

Heikki Saastamoinen

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Exceptions are events that cannot be handled by an information system by following normal processing rules. Exceptions arise for two main reasons: flaws in system design and post implementation changes in the system domain. Only few exceptions should arise in an information system serving its user community well. In practice, this is rarely the case and exceptions are sometimes rather common even with routine processes. In this paper, an exception‑based approach to evaluate information systems is presented together with practical examples of its use. The benefits of the analysis to information system management are elaborated on.

 

Keywords: Information Systems Evaluation, Exception Handling, Information Systems Management

 

Share |

Journal Article

Performance Evaluation of e‑Business in Australia  pp71-80

Mohini Singh, John Byrne

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

The Internet and related technologies have made a substantial impact on the way organisations conduct business in Australia and around the world. Australian organisations like their international counterparts have invested heavily to leverage the Internet and transform their traditional businesses into e‑businesses in the last seven years. E‑business investments are claiming a sizeable share of overall IT budgets in most organisations whether they are small, medium or large. However, managers are under constant pressure to justify e‑business costs and to ensure that these investments keep paying off. Earlier research on e‑business in Australia addressed issues of the rate of e‑business uptake and the application of the Internet to certain business processes. Research discussed in this paper is one of the first attempts to evaluate the value of e‑business. It is based on data collected, collated and analysed from the responses received from IT and e‑business managers throughout Australia. Research presented in this paper is based on a model developed in the USA (Barua et al, 2001) to identify the impact of e‑business drivers on operational excellence of firms which influence financial improvements. It was initiated to quantify the success of e‑business in Australia after huge losses from e‑business projects were reported by a few large organisations. The paper includes a review of literature on e‑business evaluation, research methodology, analysis techniques, a discussion of e‑business performance in Australia and presents the impact of e‑business on operational excellence and financial performance of the organisation.

 

Keywords: e-business evaluation, B2B e-business, B2C e-business, e-business drivers, e-business operational improvements, e-business financial success

 

Share |

Journal Article

The Eleven Years of the European Conference on IT Evaluation: Retrospectives and Perspectives for Possible Future Research  pp81-98

Egon Berghout, Dan Remenyi

© Sep 2005 Volume 8 Issue 2, Editor: Dan Remenyi, pp81 - 142

Look inside Download PDF (free)

Abstract

This paper provides an overview of the papers that have been presented at the European Conference on IT Evaluation during the past eleven years. It considers the main issues, and learning themes addressed in papers presented to these Conferences. The paper also reflects on the possible future direction, which this research may take and three major research themes are suggested. Some 356 papers have been presented at ECITE. Over the eleven year period it is clear that the level of understanding as reflected in the papers has significantly increased. Themes, which were particularly well addressed, include IT and IS value, the multidisciplinary nature of evaluation, the importance of stakeholder analysis, organisational learning and life cycle management. Three issues are identified as particularly important for further research. These are, the theoretical underpinning of IT evaluation, improving the data sets for research and establishing a more common core of concepts.

 

Keywords: IT, IS, Evaluation, Theoretical frameworks, empirical research, case studies, questionnaires, core concepts, corporate politics, data sets, research maturity

 

Share |

Journal Article

Broadening Information Systems Evaluation Through Narratives  pp115-122

Jonas Hedman, Andreas Borell

© Sep 2005 Volume 8 Issue 2, Editor: Dan Remenyi, pp81 - 142

Look inside Download PDF (free)

Abstract

The purpose of information systems post‑evaluation ought to be to improve the use of systems. The paper proposes the use of narratives as a tool in post‑evaluations. The potential in narratives is that they can convey meanings, interpretations, and knowledge about the system, which may potentially lead to action. The paper offer three main suggestions: 1) evaluations should form the basis for action; 2) narratives makes evaluation more relevant; and 3) post‑evaluations should be done with the aim of improving use. Narratives should be viewed as a complement to traditional evaluation methods and as a way of making evaluation more formative and thereby moving away from the more common summative perception of evaluation. The conclusion of the paper is that narratives can advance IS evaluation and provide a richer evaluation picture by conveying meanings not included in traditional evaluations.

 

Keywords: Narratives, information systems evaluation, measurements, measure, stories, action

 

Share |