In this study, the authors compared the results of traditional Angoff and Hofstee standard-setting exercises with the Mastery Angoff and Patient-Safety approaches for central venous catheter (CVC) insertion skills examinations” Barsuk et al (2018).
Abstract:
PURPOSE: Defensible minimum passing standards (MPSs) must be used to evaluate learner performance outcomes in health professions education. In this study, the authors compared the results of traditional Angoff and Hofstee standard-setting exercises with the Mastery Angoff and Patient-Safety approaches for central venous catheter (CVC) insertion skills examinations. The authors also evaluated how these standards affected evaluation of the historical performance of residents who participated in a simulation-based mastery learning (SBML) curriculum for CVC insertion skills.
METHOD: In April and May 2015, twelve physicians with expertise in CVC insertion set MPSs for previously published internal jugular (IJ) and subclavian (SC) CVC insertion checklists using Angoff, Hofstee, Mastery Angoff, and Patient-Safety approaches. The resulting MPSs were compared using historical performance of internal medicine and emergency medicine residents who participated in CVC insertion SBML.
RESULTS: The MPSs were set as follows: Angoff: IJ 91% checklist items correct, SC 90%. Hofstee: IJ 88%, SC 90%. Mastery Angoff :IJ 98%, SC 98%. Patient-Safety: IJ 98%, SC 98%. Based on the historical performance of 143 residents assessed on IJ and SC insertion, applying the 98% MPS would result in additional practice and retesting of 55/123 residents (45%) who had previously passed the IJ examination and 36/130 residents (28%) who had passed the SC examination using the Angoff and Hofstee MPSs.
CONCLUSIONS: The Mastery Angoff and Patient-Safety standard-setting approaches resulted in higher CVC insertion SBML MPSs compared to traditional standard-setting methods. Further study should assess the impact of these more rigorous standards on patient outcomes.
[ctt link=”k61S7″ template=”1″]ReTweet if useful… Simulation-based mastery learning curriculum for CVC insertion skills https://ctt.ec/k61S7+ @ivteam #ivteam[/ctt]
Reference:
Barsuk, J.H., Cohen, E.R., Wayne, D.B., McGaghie, W.C. and Yudkowsky, R. (2018) A Comparison of Approaches for Mastery Learning Standard Setting. Academic Medicine. February 20th. [epub ahead of print].
doi: 10.1097/ACM.0000000000002182.
Thank you to our partners for supporting IVTEAM
[slideshow_deploy id=’23788’]