This paper provides an overview of the papers that have been presented at the European Conference on IT Evaluation during the past eleven years. It considers the main issues, and learning themes addressed in papers presented to these Conferences. The paper also reflects on the possible future direction, which this research may take and three major research themes are suggested. Some 356 papers have been presented at ECITE. Over the eleven year period it is clear that the level of understanding as reflected in the papers has significantly increased. Themes, which were particularly well addressed, include IT and IS value, the multidisciplinary nature of evaluation, the importance of stakeholder analysis, organisational learning and life cycle management. Three issues are identified as particularly important for further research. These are, the theoretical underpinning of IT evaluation, improving the data sets for research and establishing a more common core of concepts.

Given the plethora of frameworks and models available in this area, not all could be evaluated here. This paper takes seven popular frameworks and examines aspects of IT evaluation with particular emphasis on Small to Medium Enterprises (SMEs). The frameworks were selected from the most well known of IT evaluation research including Delone and McLean, 1992, Seddon et.al. 1999, Farbey et.al, 1999, Levy et.al., 1998. Most of the frameworks were developed for large organisations and therefore those chosen were evaluated for their applicability to the world of SMEs. These are categorised into four areas: people issues, technology focus, evolutionary position and management aspects. The conclusion is reached that the use of a multi‑framework is needed for all organisations. This presents severe difficulties in larger organisations, as the problems of communications can be a stumbling block to completing the evaluation. However, this paper proposes that SMEs may find it easier to take parts of 'tested' frameworks used by larger companies and apply them. The communication links within SMEs are neither as complex nor as highly developed as in large organisations that may make this an appropriate approach.