Relationships Between Self-Assessment Skills, Test Performance, and Demographic Variables in Psychiatry Residents

Authors: Lynn, David; Holzer, Charles; O’Neill, Patrick

Source: Advances in Health Sciences Education, Volume 11, Number 1, February 2006 , pp. 51-60(10)

Publisher: Springer

Buy & download fulltext article:

OR

Price: $47.00 plus tax (Refund Policy)

Abstract:

Some researchers have seen the capacity for self-assessment in trainees as a special skill, and some reports have concluded that this skill is positively and crucially correlated with academic competence. Thus, it is believed that those trainees who are most deficient in knowledge are least likely to be aware of their limitations. Other researchers have emphasized the impact of statistical regression and other technical considerations in the studies, which have led to these conclusions. Our study used a relative-ranking design to measure the accuracy of self-assessments of both strengths and weaknesses in psychiatry residents. We analyzed the relationships between indices of self-assessment accuracy and other resident characteristics, particularly current academic strength as measured by a standard test of psychiatric knowledge. A total of 56 residents in two general psychiatry programs evaluated their performance on the Psychiatry Resident in Training Examination by estimating the rank order of their scores in the 11 psychiatry subject areas. For each resident, actual examination results were then used to generate measures of the accuracy of the identification of strengths and weaknesses. Residents’ identifications of their strengths and weaknesses were significantly more accurate than chance levels. Strengths and weaknesses were identified with roughly equal proficiency, and accuracy in these assessments was not correlated to any of the following variables: academic competence as measured by examination raw scores, postgraduate year, gender, international vs. American medical education, program membership, or age. Our results do not support the hypothesis that trainees who show the least academic mastery also make the most inaccurate self-assessments. In addition, we found no resident characteristics that accounted for variation in self-assessment accuracy.

Keywords: competence; medical education; psychiatry; residency training; self-assessment

Document Type: Research Article

DOI: http://dx.doi.org/10.1007/s10459-005-5473-4

Affiliations: Email: david.lynn@jefferson.edu

Publication date: February 1, 2006

Related content

Key

Free Content
Free content
New Content
New content
Open Access Content
Open access content
Subscribed Content
Subscribed content
Free Trial Content
Free trial content

Text size:

A | A | A | A
Share this item with others: These icons link to social bookmarking sites where readers can share and discover new web pages. print icon Print this page