The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop
Journal Issue
Volume 12 Issue 2 / Dec 2009  pp129‑198

Editor: Shaun Pather

Download PDF (free)

The Influence of net Benefits on Collective, Innovative, Configural System use: a Case Study of Small‑to‑Medium Enterprises  pp129‑140

Carla Wilkin

Look inside Download PDF (free)

An Evaluation of the Theory of Planned Behaviour in Consumer Acceptance of Online Video and Television Services  pp141‑150

Yann Truong

Look inside Download PDF (free)

Is a Multi‑Criteria Evaluation Tool Reserved for Experts?  pp151‑162

C. Sanga, I. M Venter

Look inside Download PDF (free)

Evaluating the Performance of Electronic Marketplaces: an Exploration of the Ownership Impact  pp163‑174

Philip O' Reilly, Pat Finnegan

Look inside Download PDF (free)

The Dilution of Effort in Self‑Evaluating Development Teams: Agile Loafing  pp175‑186

John McAvoy, Tom Butler

Look inside Download PDF (free)

ICT Evaluation in the Irish Higher Education Sector  pp187‑198

Marian Carcary

Look inside Download PDF (free)


The Information and Communications Technology (ICT) evaluation literature now spans several decades. Nonetheless, evidence continues to suggest that there remains a lack of formal ICT evaluation practices within organisations. Several challenges exist, not least the social and political contexts within which evaluation takes place and limitations in existing evaluation techniques. However, while ICT evaluation exercises have spanned many fields of study, an in‑depth review of the ICT evaluation literature revealed that there is a paucity of ICT evaluation studies within the Higher Education sector. The 14 Irish Institutes of Technology (IoTs) have recently undergone an extensive transformation of their ICT systems. A national project launched by the Department of Education and Science and the Council of Directors of the IoTs performed a nationwide implementation of a suite of integrated Information Systems for library, human resources, finance and student management functions in order to standardise the ICT systems of the IoT sector. Yet, at the time of research, no formal evaluation of this project had been completed. This paper advances the body of ICT evaluation knowledge in the tertiary education sector through evaluating the impact of the Student MIS implementation within the IoTs. The research study was interpretive in nature; case studies based on multiple evidence sources were conducted in five IoTs. Analysis of the evidence led to the distillation of 15 findings on the Student MIS implementation which were centred on five key project areas – system selection, system development in the Irish IoTs, system commissioning, ex‑post performance at system start‑up and at the time of research. The 15 findings uncovered either support existing research in the ICT evaluation field or further advance the body of ICT evaluation theoretical knowledge. This paper makes a number of valuable contributions. It enhances understanding of ICT evaluation in tertiary education. It discusses the difficulties involved in operationalising a standard ICT system in multiple diverse organisations and provides lessons with respect to managing the difficulties experienced in large‑scale government projects. 


Keywords: ICT investment management, ICT evaluation, ex-post evaluation, MIS, ICT in tertiary education


Share |