The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

ICT Evaluation in the Irish Higher Education Sector  pp187-198

Marian Carcary

© Feb 2010 Volume 12 Issue 2, Editor: Shaun Pather, pp129 - 198

Look inside Download PDF (free)

Abstract

The Information and Communications Technology (ICT) evaluation literature now spans several decades. Nonetheless, evidence continues to suggest that there remains a lack of formal ICT evaluation practices within organisations. Several challenges exist, not least the social and political contexts within which evaluation takes place and limitations in existing evaluation techniques. However, while ICT evaluation exercises have spanned many fields of study, an in‑depth review of the ICT evaluation literature revealed that there is a paucity of ICT evaluation studies within the Higher Education sector. The 14 Irish Institutes of Technology (IoTs) have recently undergone an extensive transformation of their ICT systems. A national project launched by the Department of Education and Science and the Council of Directors of the IoTs performed a nationwide implementation of a suite of integrated Information Systems for library, human resources, finance and student management functions in order to standardise the ICT systems of the IoT sector. Yet, at the time of research, no formal evaluation of this project had been completed. This paper advances the body of ICT evaluation knowledge in the tertiary education sector through evaluating the impact of the Student MIS implementation within the IoTs. The research study was interpretive in nature; case studies based on multiple evidence sources were conducted in five IoTs. Analysis of the evidence led to the distillation of 15 findings on the Student MIS implementation which were centred on five key project areas – system selection, system development in the Irish IoTs, system commissioning, ex‑post performance at system start‑up and at the time of research. The 15 findings uncovered either support existing research in the ICT evaluation field or further advance the body of ICT evaluation theoretical knowledge. This paper makes a number of valuable contributions. It enhances understanding of ICT evaluation in tertiary education. It discusses the difficulties involved in operationalising a standard ICT system in multiple diverse organisations and provides lessons with respect to managing the difficulties experienced in large‑scale government projects.

 

Keywords: ICT investment management, ICT evaluation, ex-post evaluation, MIS, ICT in tertiary education

 

Share |

Journal Article

The Implementation of a New Student Management Information System (MIS) at an Irish Institute of Technology — An Ex Post Evaluation of its Success  pp31-44

Marian Carcary, Ger Long, Dan Remenyi

© Jan 2007 Volume 10 Issue 1, ECITE 2006 Special, Editor: Dan Remenyi, pp1 - 122

Look inside Download PDF (free)

Abstract

This paper is a case study examining the impact of the introduction of a large‑scale student ICT system into an Institute of Technology (IoT) in Ireland. The system in question addresses all functions related to the ongoing administration of student affaires. It was implemented as part of a national project driven by the Department of Education and Science and the Council of Directors of the IoTs to standardise the ICT systems of the IoT sector. However, system introduction was problematic and it was necessary to support the new system with a number of additional software tools. The case study considers how well the current ICT arrangements satisfy the IoT's requirements and it identifies remedial action for future success.

 

Keywords: ICT evaluation, ex post evaluation, ICT problems, ICT benefits, functional-operational match, ICT in third level education

 

Share |

Journal Article

Bringing Together Evaluation and Management of ICT Value: A Systems Theory Approach  pp19-35

Dr Arnela Ceric

© Jul 2015 Volume 18 Issue 1, Editor: Shaun Pather, pp1 - 92

Look inside Download PDF (free)

Abstract

Abstract: The paper introduces an evaluation model for examining an Information Communication Technology (ICT) value creation process based on a systems theory method, known as cross‑impact analysis. This method enables holistic understanding of interdependencies among the system’s elements, critical for successfully evaluating and managing the system. The evaluation process focuses on six dimensions of an ICT value creation system: drivers, outcomes, identity, goals, trends and its structure. Each of these dimensions has important implications for managing the system. Thus, the evaluation model presented in this paper integrates the evaluation and management of a system, with the purpose of enabling organisational stakeholders to use the evaluation as the basis for informed management of their ICT value creation system.

 

Keywords: Keywords: Systems theory, ICT evaluation, ICT management, ICT value creation system, cross-impact analysis, interactions

 

Share |

Journal Article

Multitasking: the Uncertain Impact of Technology on Knowledge Workers and Managers  pp1-12

Frank Bannister, Dan Remenyi

© Jan 2009 Volume 12 Issue 1, ECIME 2008, Editor: Dan Remenyi, pp1 - 118

Look inside Download PDF (free)

Abstract

While the productivity paradox has now been officially pronounced dead, the argument and the evidence for this assertion are both at a macroeconomic level. What has been less closely examined is the microeconomic impact of recent developments in ICT on the productivity of office and knowledge workers. There is an assumption, readily seen in many advertisements for mobile technology, that multi‑tasking, WiFi connected laptops, Blackberrys, smart phones and so on are good for business and make people more effective and productive. This may be true some of the time and there is some (albeit limited) research which supports claims that these technologies increase productivity. However there are also emerging concerns that, in certain environments, these technologies may actually reduce productivity in both the short and the long term. This paper examines this problem and research to date and proposes a framework for further investigation of this phenomenon.

 

Keywords: multitasking, multicommunication, productivity, effectiveness, efficiency, ICT evaluation

 

Share |

Journal Issue

Volume 12 Issue 2 / Dec 2009  pp129‑198

Editor: Shaun Pather

View Contents Download PDF (free)

Keywords: analytical hierarchy process, B2C e-commerce, collective use, DeLone and McLean, developing country, e-commerce Success, e-learning systems, electronic marketplace, ex-post evaluation, free and open source software, ICT evaluation, ICT in tertiary education, ICT investment management, innovative use, investor structure, IS success, MIS, multi-criteria evaluation tool , net benefits, novice user, onfigural use, online television, online video, ownership, performance evaluation and improvement, small-to-medium enterprises, software quality, technology adoption, theory of planned behaviour, user acceptance of online videos, web TV, work-arounds

 

Share |

Journal Issue

Volume 10 Issue 1, ECITE 2006 Special / Jan 2007  pp1‑122

Editor: Dan Remenyi

View Contents Download PDF (free)

Editorial

Another edition of EJISE brings to the attention of the information systems community 10 more pieces of research into how information systems may be evaluated. The contributions in this issue are from 9 different countries and from a diverse range of universities and business schools.

When I first became actively interested in information systems’ evaluation in 1990 I had no idea of how wide and how deep an issue information systems evaluation was. I had thought that it was worth a few papers and maybe a book or two. Today my view is entirely different and I wonder if the community of information systems academics and practitioners will ever reach a point where by there will be a general agreement as to how to evaluate or assess information systems. My best guess would be that they probably will not.

However as it was put to me at the start of my university studies academics tend to have far more questions than answers and this may not necessarily be a ‘bad’ thing. If we continue to ask the right questions, even if we can’t find definitive answers we are effectively moving the frontier of knowledge forward. And that I suggest is, in the end, the most important objective of academe.

I hope that you will find a number of interesting topics among these 10 papers.

 

Keywords: IS integration, auditing, balanced score card, business process facilitation, case study, confidentiality, domain specific languages, e-Government project evaluation, enterprise information system, CEO framework, ex post evaluation, functional-operational match, ICT benefits, ICT evaluation, ICT project, information economics, Information System Architecture , IS outsourcing , IT evaluation, IT value assessment, knowledge management, meta-modelling tools, motivational factors, user satisfaction surveys, web content management, WLAN

 

Share |