American College of Surgeons: Technical Skills Education in Surgery
Foreword Introduction Background Criteria Study Design and Glossary of Terms Kirkpatrick Hierarchy FAQs
Categories and Article Reviews CME Program Selected References for Noteworthy Review Articles from the Literature
Kirkpatrick Hierarchy
 

Kirkpatrick Hierarchy for Assessment of Research Papers

Impact of intervention studied

The impact of each research paper was assessed using the Kirpatrick1 model, as adapted for medical education by the BEME collaboration group2.

Level 1 Participation – covers learners' views on the learning experience, its organization, presentation, content, teaching methods, and aspects of the instructional organization, materials, quality of instruction
Level 2a Modification of attitudes/perceptions – outcomes here relate to changes in the reciprocal attitudes or perceptions between participant groups toward intervention/simulation
Level 2b Modification of knowledge/skills – for knowledge, this relates to the acquisition of concepts, procedures and principles; for skills this relates to the acquisition of thinking/problem-solving, psychomotor and social skills
Level 3 Behavioural change – documents the transfer of learning to the workplace or willingness of learners to apply new knowledge and skills
Level 4a Change in organizational practice – wider changes in the organizational delivery of care, attributable to an educational program
Level 4b Benefits to patient/clients – any improvement in the health and well-being of patients/clients as a direct result of an educational program

1. Kirkpatrick, D. L. (1967) Evaluation of training. In Training and Development Handbook (eds R. Craig & I. Mittel), pp. 87–112. New York: McGraw Hill.

2. BEME collaboration home page: http://www.bemecollaboration.org/index.html, (accessed May 31, 2005).

BEME coding sheet: http://www.bemecollaboration.org/BEME%204%20Figs%20&%20Appendices/BEME4_Appx1.pdf

 

This page and all contents are Copyright © 2006 by the American College of Surgeons, Chicago, IL 60611-3211
ContactDisclaimerACS Home