Comparing the Ottawa Emergency Department Shift Observation Tool (O-EDShOT) to the traditional daily encounter card: measuring the quality of documented assessments

Objectives The Ottawa Emergency Department Shift Observation Tool (O-EDShOT) is a workplace-based assessment designed to assess a trainee’s performance across an entire shift. It was developed in response to validity concerns with traditional end-of-shift workplace-based assessments, such as the dai...

Full description

Saved in:
Bibliographic Details
Published in:Canadian journal of emergency medicine 2021-05, Vol.23 (3), p.383-389
Main Authors: Endres, Kaitlin, Dudek, Nancy, McConnell, Meghan, Cheung, Warren J.
Format: Article
Language:English
Subjects:
Emergency medical care
Emergency Medicine
Medicine
Medicine & Public Health
Original Research
Public Health
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Objectives The Ottawa Emergency Department Shift Observation Tool (O-EDShOT) is a workplace-based assessment designed to assess a trainee’s performance across an entire shift. It was developed in response to validity concerns with traditional end-of-shift workplace-based assessments, such as the daily encounter card. The O-EDShOT previously demonstrated strong psychometric characteristics; however, it remains unknown whether the O-EDShOT facilitates measurable improvements in the quality of documented assessments compared to daily encounter cards. Methods Three randomly selected daily encounter cards and three O-EDShOTs completed by 24 faculty were scored by two raters using the Completed Clinical Evaluation Report Rating (CCERR), a previously published 9-item quantitative measure of the quality of a completed workplace-based assessment. Automated-CCERR (A-CCERR) scores, which do not require raters, were also calculated. Paired sample t tests were conducted to compare the quality of assessments between O-EDShOTs and DECs as measured by the CCERR and A-CCERR. Results CCERR scores were significantly higher for O-EDShOTs (mean(SD) = 25.6(2.6)) compared to daily encounter cards (21.5(3.9); t (23) = 5.2, p  
ISSN:1481-8035
1481-8043
DOI:10.1007/s43678-020-00070-y