What is it about?
A method for assessment of evaluation processes, applicable to systems in which both measurable and policy-based performance criteria coexist is proposed. The main idea is that the principal aspects of the system, as extracted from the objective indicators (built from measurable observations), allow the mapping of the subjects under evaluation, without using weights, and then less objective criteria are subsequently introduced. Performance maps are presented and inspected for a set of Research and Development institutions, to illustrate examples of application of the methodology proposed.
Featured Image
Why is it important?
The present work deals with an important topic on the use of multiple indicators in evaluation systems: how can ‘objective’ measurable and so-called ‘policy’ criteria be combined in an evaluation system? A straightforward method is proposed for performance assessment, relying on a dynamic three-step process involving both quantitative and subjective or policy-making components. It is extremely relevant, when trying to characterize productivity, to establish a clear distinction between objective and policy dimensions. The proposed procedure underlines the necessity of setting up an efficient system, in order to assess the impact of the different criteria.
Perspectives
The method can have a broader application than that described in this article. In fact, it can be used in any situation in which relevant numerical indicators provide a basis for the mapping, and other criteria, of any type (even also based on metrics), are subsequently introduced.
Dr Tânia F. G. G. Cova
Universidade de Coimbra
Read the Original
This page is a summary of: Seeing is believing: A graphical reference framework for multi-criteria evaluation, Evaluation, October 2017, SAGE Publications,
DOI: 10.1177/1356389017733336.
You can read the full text:
Contributors
The following have contributed to this page
