Evaluation in experimental programmes: perspectives from ‘realist evaluation’

Authors

DOI:

https://doi.org/10.4000/cea.1569

Keywords:

Programa de desenvolvimento, Avaliação, Metodologia

Abstract

Experience of assessment in experimental programmes based on conventional methodologies has come to arouse increasing dissatisfaction. The search for alternatives is increasingly attracting attention and the promotion of innovation poses specific challenges to the processes of assessment. «Realistic assessment» is a proposal intended to overcome this dissatisfaction. The perspective presented here is rooted in the author's experience of assessment within the context of experimental programmes. This experiment began by attempting to incorporate some epistemological and methodological procedures, taking as their reference the work of Andrew Sayer in the field of «critical» realism (A. Sayer, 1984). The experiment developed at the time serves as a personal reference for the development of the perspective outlined below (J. M. Henriques, 2001; 2000; 1994; 1993).

References

T. BENNEIT, «What's New in Evaluation Research? A note on the Pawson and Tilley article», in British Journal of Criminology, vol 36, n.º 4, Oxford, The Institute for the Study and Treatment of Delinquency, Kings College/Oxford University Press, 1996.

DOI : 10.1093/oxfordjournals.bjc.a014111

D. FARRINGTON, «Evaluating Communities That Care's: realistic scientific considerations», in Evaluation, vol. 4 (2), London Sage, 1988.

J. M. HENRIQUES (coord.), Avaliação Intercalar do Programa de Reabilitaçãn Urbana, Lisboa, DGDR, 2001.

J. M. HENRIQUES (coord.), «Empawerment»: Avaliação de Projectos Locais (volume I e II), Lisboa, Gabinete de Gestão das Iniciativas Comunitárias Emprego & Adapt., 2000.

J. M. HENRIQUES, «National Evaluation of Poverty III in Portugal», in S. O'CINNEIDE, Evaluation in Poverty III (volume II), BruxeUes, Comission of the European Communities, 1993.

J. M. HENRIQUES (coord.), «Local Development in Poverty III», in The lessons of the Poverty III Programme, Bruxelles, Commission of the European Communities, 1994.

M. HUGHES & T. TRAYNOR, «Reconciling Process and Outcome in Evaluating Community Initiatives», in Evaluation, vol. 6 (1), London, Sage, 2000.

DOI : 10.1177/13563890022209109

R. HUMMELBRUNNER, «A Systems Approach to Evaluation: applications of systems theory and systems thinking in evaluations», paper prepared for the 4th Conference of the European Evaluation Society, Lausanne, October 12, 2000.

G. JULNES, M. MARK & G. HENRY, «Promoting Realism in Evaluation: realistic evaluation and the broader context», in Evaluation, vol. 4 (4), London, Sage, 1988.

DOI : 10.1177/13563899822208743

T. LAWSON, Economics & Reality, London, Routledge, 1997.

W. OUTHWAITE, New Philosophies of Social Science: Realism, Hermeneutics and Critical Theory, London, MacMillan, 1987.

R. PAWSON & N. TILLEY, «What Works in Evaluation Research?», in British ]ournal of Criminology, vol. 34, n.0 3, Oxford, The Institute for the Study and Treatment of Delinquency, Kings CoUege/Oxford University Press, 1994.

R. PAWSON & N. TILLEY, Realistic Evaluation, London, Sage, 1997a, (3rd edition, 2000).

R. PAWSON & N. TILLEY, «An Introduction to Scientific Realist Evaluation», in E. CHELIMSKY & W. SHADISH (eds.), Evaluation for the 21st Century, London Sage, 1997b.

R. PAWSON & N. TILLEY, «Caring Communities, Paradigm Polemics, Design Debates», in Evaluation, vol. 4 (1), London, Sage, 1998a.

DOI : 10.1177/13563899822208400

R. PAWSON & N. TILLEY, «Cook-Book Methods and Disastrous Recipes: a rejoinder to Farrington», in Evaluation, vol. 8(2), London, Sage, 1998b.

DOI : 10.1177/13563899822208545

R. PAWSON, «Evidence-based Policy: in search of a method», in Evaluation, vol. 8 (2), London, Sage, 2002a.

R. PAWSON, «Evidence-based Policy: the promise of realist synthesis», in Evaluation, vol. 8(3), London, Sage, 2002b.

B. PERRIN, «How to — and How Not to —Evaluate Innovation», in Evaluation, vol. 8(1), London, Sage, 2002.

I. SANDERSON, «Evaluation in Complex Policy Systems», in Evaluation, vol. 6(4), London, Sage, 2000.

W. OUTHWAITE, New Philosophies of Social Science: Realism, Hermeneutics and Critical Theory, London, MacMillan, 1987.

A. SAYER, Method in Social Science: a realist approach, London, Hutchinson, 1984.

A. SAYER, Realism and Social Science, London, Sage, 2000.

DOI : 10.4135/9781446218730

Published

2016-02-26