Comparing Announced with Unannounced Standardized Patients in Performance Assessment
Abstract:Background: Accurately assessing how physicians perform in practice remains an unresolved psychometric challenge. Neither chart reviews nor patient surveys indicate when physicians overlook important information, which can result in a missed opportunity for a correct diagnosis and appropriate plan of care. Standardized patient (SP) assessments provide an opportunity for direct observation of clinical behavior and are increasingly used in licensure examinations. (SPs who are sent incognito are termed unannounced standardized patients [USPs].) One study showed that physicians had particular difficulty adapting care to individual patient context ("contextual error"). In a subsequent study with the same actors, SP cases, and outcomes, an intervention was deployed to reduce contextual error among medical students. In an exploratory reanalysis of data from the two studies, clinicians' assessments of SPs and USPs were compared.
Methods: Participants in the first study were 65 board-certified internists visited by USPs; the 59 participants in the second were fourth-year medical students examining SPs in a clinical performance center.
Results: Attending physicians measured with USPs significantly underperformed medical students measured with SPs in the probing of biomedical red flags (odds ratio [OR] = 0.45 [0.30 to 0.67]) and contextual red flags (OR = 0.66 [0.45 to 0.99]) and in planning appropriate care (OR = 0.43 [0.27 to 0.67]).
Conclusions: Across these two studies, attending physicians underperformed medical students on the same outcomes, measured with the same patient cases presented by the same actors. Studies that seek to assess elicitation and incorporation of patient information by physicians as mea sures of individualization of care should weigh the benefits and costs of direct observation by USPs.
Document Type: Research Article
Publication date: 2013-02-01
More about this publication?
- The Joint Commission Journal on Quality and Patient Safety will be published by Elsevier beginning in 2017! For readers who receive access to the journal through their institutions, the journal can now be found on ScienceDirect (http://www.sciencedirect.com/science/journal/15537250). For librarians looking to subscribe to the journal for their institutions please contact your Elsevier Account Manager or visit www.myelsevier.com for more information. All other readers, please visit http://www.jointcommissionjournal.com/ to subscribe to the journal or to claim your access for an existing subscription.
- Editorial Board
- Information for Authors
- Subscribe to this Title
- Information for Advertisers
- Reprints and Permissions
- Ingenta Connect is not responsible for the content or availability of external websites