BACKGROUND: This pilot study assessed the feasibility of using first person (1P) video recording with Google Glass (GG) to assess procedural skills, as compared with traditional third person (3P) video. We hypothesized that raters reviewing 1P videos would visualize more procedural steps with greater inter-rater reliability than 3P rating vantages.
METHODS: Seven subjects performed simulated internal jugular catheter insertions. Procedures were recorded by both Google Glass and an observer’s head-mounted camera. Videos were assessed by 3 expert raters using a task-specific checklist (CL) and both an additive- and summative-global rating scale (GRS). Mean scores were compared by t-tests. Inter-rater reliabilities were calculated using intraclass correlation coefficients.
RESULTS: The 1P vantage was associated with a significantly higher mean CL score than the 3P vantage (7.9 vs 6.9, P = .02). Mean GRS scores were not significantly different. Mean inter-rater reliabilities for the CL, additive-GRS, and summative-GRS were similar between vantages.
CONCLUSIONS: 1P vantage recordings may improve visualization of tasks for behaviorally anchored instruments (eg, CLs), whereas maintaining similar global ratings and inter-rater reliability when compared with conventional 3P vantage recordings.
Evans, H.L., O’Shea, D.J., Morris, A.E., Keys, K.A., Wright, A.S., Schaad, D.C. and Ilgen, J.S. (2015) A comparison of Google Glass and traditional video vantage points for bedside procedural skill assessment. American Journal of Surgery November 10th. .
Thank you to our partners for supporting IVTEAM