Kirkpatrick Hierarchy for Assessment of Research Papers
Impact of Intervention Studied
The impact of each research paper was assessed using the Kirpatrick1 model, as adapted for medical education by the BEME collaboration group2.
Level 1 |
Participation – covers learners' views on the learning experience, its organization, presentation, content, teaching methods, and aspects of the instructional organization, materials, quality of instruction |
Level 2a |
Modification of attitudes/perceptions – outcomes here relate to changes in the reciprocal attitudes or perceptions between participant groups toward intervention/simulation |
Level 2b |
Modification of knowledge/skills – for knowledge, this relates to the acquisition of concepts, procedures and principles; for skills this relates to the acquisition of thinking/problem-solving, psychomotor and social skills |
Level 3 |
Behavioural change – documents the transfer of learning to the workplace or willingness of learners to apply new knowledge and skills |
Level 4a |
Change in organizational practice – wider changes in the organizational delivery of care, attributable to an educational program |
Level 4b |
Benefits to patient/clients – any improvement in the health and well-being of patients/clients as a direct result of an educational program |
1. Kirkpatrick, D. L. (1967) Evaluation of training. In Training and Development Handbook (eds R. Craig & I. Mittel), pp. 87–112. New York: McGraw Hill.
2. BEME collaboration home page: http://www.bemecollaboration.org/index.html, (accessed May 31, 2005).
BEME coding sheet: http://www.bemecollaboration.org/BEME%204%20Figs%20&%20Appendices/BEME4_Appx1.pdf
Revised June 29, 2011